186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.078125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:48.078136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.078147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:48.078160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.078583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.078597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.078614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.078806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2350 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b33bc47-6246331d-28affa13-1b019dc0_0
2025-10-01T14:14:48.079302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b33bc47-6246331d-28affa13-1b019dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:48.083200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Write session: try to update token
2025-10-01T14:14:48.083219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:48.101244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId: src_id|6b33bc47-6246331d-28affa13-1b019dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:48.101896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:48.101926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.101929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:48.101931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:48.101942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.101949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.102193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.102287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:48.102309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.102313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:48.102516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:48.102531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:48.102537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:48.102541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:48.104180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:48.146445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256604971462196:7265]
2025-10-01T14:14:48.146761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2349, pipe: [1:7556256604971462196:7265]
2025-10-01T14:14:48.247050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:48.247578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.247601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.247646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462196:7265], now have 1 active actors on pipe
2025-10-01T14:14:48.247860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:48.247848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:48.247887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256604971462196:7265]
2025-10-01T14:14:48.247907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:48.247910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:48.247966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2350 reason: error at write: Disconnected sessionId: src_id|6b33bc47-6246331d-28affa13-1b019dc0_0
2025-10-01T14:14:48.248123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2350 sessionId: src_id|6b33bc47-6246331d-28affa13-1b019dc0_0 is DEAD
2025-10-01T14:14:48.248279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:48.248288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Write session will restart in 0.009692s
2025-10-01T14:14:48.248309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Write session: Do CDS request
2025-10-01T14:14:48.248314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:48.258860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.258968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:48.258987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2351
2025-10-01T14:14:48.259128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.259173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:48.259185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:48.259187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:48.259444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:48.259559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2351 sessionId:  describe result for acl check
2025-10-01T14:14:48.259597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:48.259603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:48.259605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:48.259609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256604971462460:6190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:48.260093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256604971462460:6190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:48.260445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:48.260597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:48.260609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:48.260643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:48.260693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:48.260746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256602594557180:8942]
2025-10-01T14:14:48.261346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:48.261573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:48.261618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:48.261918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:48.262026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.262034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.262035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.262036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.262037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.262038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.262039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.262040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.262042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.262043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.262044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.262045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.262046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.262048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.262053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.262062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.262066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.262070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.262074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.262077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.262081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.262085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.262089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.262093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.262096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.262100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.262103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.262107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.262112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.262120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.262127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.262132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.262136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.262141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.262145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.262150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.262155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.262160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.262164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.262169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.262173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.262179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.262183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.262216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256604971462460:6190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:48.262188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.262192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.262197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.262201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.262206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.262211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.262217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.262221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.262226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.262230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.262235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.262239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.262244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.262283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:48.265599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256604971462460:6190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:48.265616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256604971462460:6190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:48.265618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256604971462460:6190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:48.265624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:48.265872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:48.267161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2350
2025-10-01T14:14:48.267176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2350
2025-10-01T14:14:48.266855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:48.266872Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:48.266874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:48.266876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:48.266882Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2350 [2:7556256602594557180:8942]
2025-10-01T14:14:48.266892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:48.266904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:48.266906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.266909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.266910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.266923Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:48.266926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:48.266930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:48.266975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.266977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.266979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.266982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:48.266985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:48.267051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:48.267053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.267060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.267066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.267076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:48.267089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462498:6190], now have 1 active actors on pipe
2025-10-01T14:14:48.267093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462198:2446], now have 1 active actors on pipe
2025-10-01T14:14:48.267098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.267099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.267100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.267111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:48.267122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:48.267127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:48.267130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:48.267132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:48.267134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:48.267137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:48.267170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.267177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:48.267185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:48.267214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.267218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.267241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16cb3fa-570884d1-de538801-b92675e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:48.267248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.267252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.267255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:48.267263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.267272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:48.267284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.267404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.267413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.267425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.267498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2351 partition: 0 MaxSeqNo: 45 sessionId: src_id|16cb3fa-570884d1-de538801-b92675e5_0
2025-10-01T14:14:48.267791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b33bc47-6246331d-28affa13-1b019dc0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16cb3fa-570884d1-de538801-b92675e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:48.270885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Write session: try to update token
2025-10-01T14:14:48.270904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:48.284781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:48.284803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.284814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.284861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:48.284864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:48.285039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:48.285191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:48.285347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:48.285503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:48.285720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:48.285765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:48.286509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId: src_id|16cb3fa-570884d1-de538801-b92675e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:48.289311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:48.289535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.289559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.289601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:48.289702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:48.302795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:48.302820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.302823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:48.302825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:48.302835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.302839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.302842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256602594557174:8942]
2025-10-01T14:14:48.302895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:48.302906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.302909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:48.303058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:48.303236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:48.303242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:48.303246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:48.348215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256604971462506:7265]
2025-10-01T14:14:48.348527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2350, pipe: [1:7556256604971462506:7265]
2025-10-01T14:14:48.472217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:48.481391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.481423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.481587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.481647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.481705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.481760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.481799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.481804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.481874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.481933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.481993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.482051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.482093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.482096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.482168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.482227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.482283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.482344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.485155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256604971462506:7265]
2025-10-01T14:14:48.485185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:48.485223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:48.485225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:48.485247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2351 reason: error at write: Disconnected sessionId: src_id|16cb3fa-570884d1-de538801-b92675e5_0
2025-10-01T14:14:48.485412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2351 sessionId: src_id|16cb3fa-570884d1-de538801-b92675e5_0 is DEAD
2025-10-01T14:14:48.482494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.482506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.482573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.482627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.482683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.482742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.482781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.482784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.482848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.482905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.482966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.483027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.483067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.483070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.483138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.483196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.483257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.483317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.483360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.483363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.483430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.483485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.483549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.483609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.483648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.483651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.483735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.483801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.483874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.483949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.484003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.484006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.484077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.484136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.484198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.484262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.484304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.486462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:48.486480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Write session will restart in 0.008175s
2025-10-01T14:14:48.486508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Write session: Do CDS request
2025-10-01T14:14:48.486517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:48.484306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.484371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.484430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.484494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.484550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.484606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.484608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.484685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462506:7265], now have 1 active actors on pipe
2025-10-01T14:14:48.486499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:48.496321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.496680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:48.496698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2352
2025-10-01T14:14:48.496812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.496839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:48.496845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:48.496849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:48.497213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2352 sessionId:  describe result for acl check
2025-10-01T14:14:48.497247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:48.497249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:48.497251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:48.497256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256604971462584:6177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:48.497798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256604971462584:6177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:48.501356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256604971462584:6177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:48.508941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256604971462584:6177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:48.508962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256604971462584:6177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:48.508965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256604971462584:6177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:48.508975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:48.510973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:48.511730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:48.511923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:48.511928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:48.511941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:48.511996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:48.512035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256602594557397:8921]
2025-10-01T14:14:48.512546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:48.512904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:48.512950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:48.513287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:48.513337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.513339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.513340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.513341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.513342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.513343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.513344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.513345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.513346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.513347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.513348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.513349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.513350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.513351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.513357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.513367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.513371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.513375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.513379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.513384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.513388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.513392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.513396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.513401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.513405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.513408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.513412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.513416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.513423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.513431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.513437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.513443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.513448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.513453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.513458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.513463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.513468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.513473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.513478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.513483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.513488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.513493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.513497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.513503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.513507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.513512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.513517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.513522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.513526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.513533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.513537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.513542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.513546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.513551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.513555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.513560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.513599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:48.521947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2351
2025-10-01T14:14:48.521992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2351
2025-10-01T14:14:48.518953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:48.519784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:48.519792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:48.519795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:48.519801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:48.519809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2351 [2:7556256602594557397:8921]
2025-10-01T14:14:48.519833Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:48.519853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:48.519857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.519860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.519863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.519883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:48.519890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:48.519898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:48.520004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.520009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.520011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.520015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:48.520017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:48.520283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:48.520286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.520299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.520310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.520327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:48.520344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.520346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.520348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.520364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:48.520380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:48.520395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:48.520400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:48.520445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.520447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:48.521048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:48.521051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:48.521054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:48.521060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:48.522080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462514:2446], now have 1 active actors on pipe
2025-10-01T14:14:48.522086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462805:6177], now have 1 active actors on pipe
2025-10-01T14:14:48.522286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.522293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.522324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:48.522333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.522340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.522343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:48.522355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.522401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:48.522421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.524671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2352 partition: 0 MaxSeqNo: 45 sessionId: src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0
2025-10-01T14:14:48.523127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.523145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.523167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.525749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cb3fa-570884d1-de538801-b92675e5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:48.528889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Write session: try to update token
2025-10-01T14:14:48.528909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:48.551596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId: src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:48.554616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:48.556338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.556370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.556393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:48.556395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.556398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:48.556400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:48.556408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.556414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.556418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256602594557392:8921]
2025-10-01T14:14:48.556468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:48.556475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:48.556480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:48.556482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.556484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:48.556485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:48.556651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:48.585802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256604971462826:7265]
2025-10-01T14:14:48.586074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2351, pipe: [1:7556256604971462826:7265]
2025-10-01T14:14:48.708169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:48.708715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:48.708781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462826:7265], now have 1 active actors on pipe
2025-10-01T14:14:48.708855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:48.708951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256604971462826:7265]
2025-10-01T14:14:48.708980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:48.718977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:48.718994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:48.719014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2352 reason: error at write: Disconnected sessionId: src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0
2025-10-01T14:14:48.719181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2352 sessionId: src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0 is DEAD
2025-10-01T14:14:48.719278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:48.719290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Write session will restart in 0.009685s
2025-10-01T14:14:48.719317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Write session: Do CDS request
2025-10-01T14:14:48.719328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:48.725568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:48.727155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:48.727297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:48.727304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:48.727312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:48.727342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:48.727376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256602594557598:8916]
2025-10-01T14:14:48.727752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:48.727971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:48.728006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:48.728224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:48.728265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.728270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.728270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.728271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.728272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.728272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.728273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.728274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.728275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.728275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.728276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.728277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.728278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.728278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.728281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.728287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.728289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.728291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.728293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.728295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.728297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.728299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.728302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.728304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.728306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.728308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.728310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.728312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.728317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.728321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.728325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.728328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.728332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.728335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.728337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.728340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.728342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.728345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.728347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.728350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.728352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.728355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.728358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.728360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.728363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.728367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.728369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.728372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.728375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.728377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.728379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.728382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.728387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.728389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.728392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.728396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.728428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:48.729928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.729979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:48.729994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2353
2025-10-01T14:14:48.730127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.730149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:48.730156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:48.730160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:48.730491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2353 sessionId:  describe result for acl check
2025-10-01T14:14:48.730523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:48.730524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:48.730526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:48.730529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256604971463101:6165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:48.730923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256604971463101:6165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:48.731936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:48.732621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:48.732637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:48.732639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:48.732643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:48.732650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2352 [2:7556256602594557598:8916]
2025-10-01T14:14:48.732670Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:48.732686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:48.732694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.732697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.732700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.732716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:48.732726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:48.732737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:48.732792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.732800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.732802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.732805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:48.732808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:48.732879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:48.732886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.732897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.732913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.732934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:48.732953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462832:2446], now have 1 active actors on pipe
2025-10-01T14:14:48.732965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.732967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.732969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.732981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:48.732999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:48.732999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:48.732982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2352
2025-10-01T14:14:48.733002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:48.733004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:48.733018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:48.733021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:48.733048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.733060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:48.733070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:48.733648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256604971463101:6165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:48.739393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256604971463101:6165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:48.739411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256604971463101:6165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:48.739414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256604971463101:6165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:48.739421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:48.739684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971463139:6165], now have 1 active actors on pipe
2025-10-01T14:14:48.739730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2352
2025-10-01T14:14:48.739800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.739822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.739860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:48.739876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.739886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.739889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:48.739901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.739920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:48.739945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.740123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.740139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.740165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.740233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2353 partition: 0 MaxSeqNo: 45 sessionId: src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0
2025-10-01T14:14:48.740588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604f7f43-e7f3a09e-9671efa7-c43138f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:48.743435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:48.743450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.743459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.743504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:48.743517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:48.743657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Write session: try to update token
2025-10-01T14:14:48.743675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:48.743683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:48.743836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:48.744001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:48.744151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:48.744355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:48.744401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:48.760529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId: src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:48.763238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:48.764826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.764858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.764884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:48.764887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.764890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:48.764893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:48.764904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.764910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.764916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256602594557593:8916]
2025-10-01T14:14:48.764963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:48.764978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:48.764982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:48.764989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:48.764997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.765007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:48.765178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:48.809166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256604971463142:7265]
2025-10-01T14:14:48.813048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2352, pipe: [1:7556256604971463142:7265]
2025-10-01T14:14:48.923711Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:48.924311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:48.924349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971463142:7265], now have 1 active actors on pipe
2025-10-01T14:14:48.924419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:48.927586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:48.927640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256604971463142:7265]
2025-10-01T14:14:48.937053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:48.937072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:48.937097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2353 reason: error at write: Disconnected sessionId: src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0
2025-10-01T14:14:48.937252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2353 sessionId: src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0 is DEAD
2025-10-01T14:14:48.937417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:48.937429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Write session will restart in 0.007229s
2025-10-01T14:14:48.937456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Write session: Do CDS request
2025-10-01T14:14:48.937464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:48.945934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.946054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:48.946073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2354
2025-10-01T14:14:48.946261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.946287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:48.946295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:48.946299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:48.946684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2354 sessionId:  describe result for acl check
2025-10-01T14:14:48.946711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:48.946713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:48.946715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:48.946719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256604971463238:6160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:48.947227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256604971463238:6160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:48.954122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256604971463238:6160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:48.963234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256604971463238:6160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:48.963255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256604971463238:6160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:48.963258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256604971463238:6160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:48.963267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:48.962935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:48.965486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:48.965753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:48.965764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:48.965776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:48.965835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:48.965898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256602594557790:8909]
2025-10-01T14:14:48.966519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:48.967057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:48.967106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:48.967424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:48.967476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.967477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.967478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.967479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.967481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.967482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.967483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.967484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.967486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.967487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.967488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.967490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.967491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.967492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.967498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.967507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.967512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.967515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.967519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.967523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.967527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.967530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.967533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.967537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.967541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.967545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.967548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.967552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.967561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.967568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.967574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.967579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.967584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.967589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.967593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.967600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.967605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.967610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.967614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.967619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.967624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.967629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.967633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.967637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.967642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.967647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.967651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.967656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.967661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.967666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.967669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.967675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.967679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.967683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.967687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.967692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.967733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:48.972332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:48.973075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:48.973088Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:48.973092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:48.973096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:48.973104Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2353 [2:7556256602594557790:8909]
2025-10-01T14:14:48.973439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:48.973465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:48.973469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.973473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.973475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.973492Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:48.973497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:48.973503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:48.973565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.973568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.973571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.973574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:48.973577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:48.973649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:48.973651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.973664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.973674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.973691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:48.973710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971463159:2446], now have 1 active actors on pipe
2025-10-01T14:14:48.973713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971463453:6160], now have 1 active actors on pipe
2025-10-01T14:14:48.973720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.973723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.973725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.973739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:48.973749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:48.973752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:48.973753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:48.973755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:48.973767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:48.973770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:48.973807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.973814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:48.973818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:48.975944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2353
2025-10-01T14:14:48.975992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2353
2025-10-01T14:14:48.976624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.976642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.976672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:48.976687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.976697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.976700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:48.976711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.976725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:48.976741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.977449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.977463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.977481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:48.977639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2354 partition: 0 MaxSeqNo: 45 sessionId: src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0
2025-10-01T14:14:48.978304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f0a1d-c8a19d16-dd43f308-6b391694_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:48.981315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Write session: try to update token
2025-10-01T14:14:48.981331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:48.995843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId: src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:48.998290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:48.999796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.999830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.999853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:48.999862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:48.999865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:48.999867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:48.999876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.999886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.999890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256602594557784:8909]
2025-10-01T14:14:48.999929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:48.999943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:48.999947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:48.999947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:48.999954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.999957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:49.000117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:49.027750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256609266430764:7265]
2025-10-01T14:14:49.028012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2353, pipe: [1:7556256609266430764:7265]
2025-10-01T14:14:49.157783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:49.158183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:49.158237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266430764:7265], now have 1 active actors on pipe
2025-10-01T14:14:49.158852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:49.158862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Write session will restart in 0.006832s
2025-10-01T14:14:49.158887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Write session: Do CDS request
2025-10-01T14:14:49.158894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:49.158386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:49.158487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:49.158490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:49.158562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2354 reason: error at write: Disconnected sessionId: src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0
2025-10-01T14:14:49.158703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2354 sessionId: src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0 is DEAD
2025-10-01T14:14:49.158874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256609266430764:7265]
2025-10-01T14:14:49.158889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:49.166978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:49.167254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:49.167271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2355
2025-10-01T14:14:49.168966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:49.168994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:49.168999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:49.169002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:49.169436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2355 sessionId:  describe result for acl check
2025-10-01T14:14:49.169476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:49.169478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:49.169481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:49.169485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256609266430844:6129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:49.169944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256609266430844:6129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:49.171727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256609266430844:6129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:49.174473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256609266430844:6129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:49.174489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256609266430844:6129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:49.174504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256609266430844:6129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:49.174512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:49.189198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:49.195927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:49.196192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:49.196197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:49.196209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:49.196266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:49.196308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256606889525283:8893]
2025-10-01T14:14:49.196944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:49.197794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:49.197843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:49.198168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:49.198399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.198400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.198401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.198403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.198404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.198405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.198406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.198408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.198409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.198410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.198412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.198412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.198413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.198415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.198421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.198431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.198435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.198438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.198441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.198444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.198447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.198451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.198454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.198457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.198460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.198464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.198467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.198471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.198481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.198487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.198494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.198499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.198504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.198510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.198514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.198519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.198524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.198530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.198534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.198539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.198545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.198549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.198553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.198558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.198562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.198567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.198571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.198577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.198581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.198585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.198589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.198593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.198599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.198603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.198607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.198611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.198648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:49.207804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:49.208529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:49.208547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:49.208550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:49.208569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:49.208577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2354 [2:7556256606889525283:8893]
2025-10-01T14:14:49.208596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:49.208616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:49.208620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:49.208623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:49.208626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:49.208643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:49.208656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:49.208663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:49.208726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.208735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.208738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.208742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:49.208745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:49.208818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:49.208825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.208837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.208853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.208871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:49.208891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.208894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.208897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.208910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:49.208930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:49.208943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:49.208951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:49.208957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:49.208968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:49.208972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:49.208988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.208997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:49.209051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:49.209474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2354
2025-10-01T14:14:49.209484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2354
2025-10-01T14:14:49.209631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266430957:6129], now have 1 active actors on pipe
2025-10-01T14:14:49.209645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266430781:2446], now have 1 active actors on pipe
2025-10-01T14:14:49.209665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.209674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.209700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77781346-b7abfb34-35dac997-46b186e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:49.209712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:49.209717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:49.209719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:49.209729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:49.209738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:49.209758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:49.209995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.210004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.210018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:49.210135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2355 partition: 0 MaxSeqNo: 45 sessionId: src_id|77781346-b7abfb34-35dac997-46b186e6_0
2025-10-01T14:14:49.210591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f39558-d89fc3cb-a4ef2665-695133aa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|77781346-b7abfb34-35dac997-46b186e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:49.214059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Write session: try to update token
2025-10-01T14:14:49.214074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:49.228066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:49.228091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:49.228102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.228156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:49.228360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:49.228521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:49.228682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:49.228829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:49.229034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:49.229071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:49.229217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:49.242914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:49.242935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:49.242937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:49.242939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:49.242948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.242951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.242955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256606889525278:8893]
2025-10-01T14:14:49.242995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:49.243001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.243003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:49.243141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:49.243992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:49.244008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:49.244011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:49.244289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId: src_id|77781346-b7abfb34-35dac997-46b186e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:49.247374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:49.259055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256609266431103:7265]
2025-10-01T14:14:49.259427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2354, pipe: [1:7556256609266431103:7265]
2025-10-01T14:14:49.495275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:49.495686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.495695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.495721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431103:7265], now have 1 active actors on pipe
2025-10-01T14:14:49.497630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:49.497644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:49.497705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2355 reason: error at write: Disconnected sessionId: src_id|77781346-b7abfb34-35dac997-46b186e6_0
2025-10-01T14:14:49.497893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2355 sessionId: src_id|77781346-b7abfb34-35dac997-46b186e6_0 is DEAD
2025-10-01T14:14:49.498053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:49.498085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256609266431103:7265]
2025-10-01T14:14:49.497818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:49.501549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:49.501565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Write session will restart in 0.006620s
2025-10-01T14:14:49.501595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Write session: Do CDS request
2025-10-01T14:14:49.501602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:49.515324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:49.515810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:49.515838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2356
2025-10-01T14:14:49.516031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:49.516065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:49.516071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:49.516075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:49.518995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2356 sessionId:  describe result for acl check
2025-10-01T14:14:49.519047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:49.519049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:49.519054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:49.519060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256609266431128:6105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:49.519629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256609266431128:6105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:49.522062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256609266431128:6105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:49.527139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256609266431128:6105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:49.527163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256609266431128:6105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:49.527168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256609266431128:6105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:49.527178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:49.570935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:49.573893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:49.574168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:49.574188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:49.574202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:49.574260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:49.574303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256606889525521:8880]
2025-10-01T14:14:49.574960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:49.575440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:49.575494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:49.575824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:49.575886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.575888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.575889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.575891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.575892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.575893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.575894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.575896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.575897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.575899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.575900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.575901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.575903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.575904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.575910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.575920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.575923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.575927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.575931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.575935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.575938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.575942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.575946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.575950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.575954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.575957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.575961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.575965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.575973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.575981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.575987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.575992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.576001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.576006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.576010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.576016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.576021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.576028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.576032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.576037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.576043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.576050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.576055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.576060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.576065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.576070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.576074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.576080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.576100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.576104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.576109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.576114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.576119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.576124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.576128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.576134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.576187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:49.585259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:49.586079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:49.586097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:49.586100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:49.586104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:49.586112Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2355 [2:7556256606889525521:8880]
2025-10-01T14:14:49.586131Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:49.586149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:49.586153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:49.586157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:49.586159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:49.586177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:49.586183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:49.586191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:49.586258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.586260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.586263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.586266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:49.586269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:49.586357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:49.586381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.586394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.586403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.586417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:49.590615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2355
2025-10-01T14:14:49.590623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2355
2025-10-01T14:14:49.586437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.586445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.586447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.586457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:49.586474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:49.586482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:49.586484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:49.586487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:49.586489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:49.586492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:49.586754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.586764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:49.586780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431108:2446], now have 1 active actors on pipe
2025-10-01T14:14:49.586784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431176:6105], now have 1 active actors on pipe
2025-10-01T14:14:49.586852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:49.594534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.594553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.594598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:49.594614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:49.594622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:49.594625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:49.594639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:49.594658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:49.594690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:49.596177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.596191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.596214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431426:7265], now have 1 active actors on pipe
2025-10-01T14:14:49.596235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:49.595274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256609266431426:7265]
2025-10-01T14:14:49.600025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77781346-b7abfb34-35dac997-46b186e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:49.599473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2355, pipe: [1:7556256609266431426:7265]
2025-10-01T14:14:49.599535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2356 partition: 0 MaxSeqNo: 45 sessionId: src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0
2025-10-01T14:14:49.603817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Write session: try to update token
2025-10-01T14:14:49.603841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:49.641180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId: src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:49.643990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:49.645565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.645590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.645612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:49.645616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:49.645618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:49.645620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:49.645629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.645633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.645637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256606889525516:8880]
2025-10-01T14:14:49.645694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:49.645701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.645703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:49.645854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:49.648376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:49.648392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:49.648400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:49.872351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:49.872705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:49.873837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256609266431426:7265]
2025-10-01T14:14:49.873876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:49.873914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:49.873989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:49.873991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:49.874069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2356 reason: error at write: Disconnected sessionId: src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0
2025-10-01T14:14:49.874219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2356 sessionId: src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0 is DEAD
2025-10-01T14:14:49.877231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:49.877244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Write session will restart in 0.006613s
2025-10-01T14:14:49.877273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Write session: Do CDS request
2025-10-01T14:14:49.877279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:49.889184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:49.889546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:49.889562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2357
2025-10-01T14:14:49.889722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:49.889752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:49.889757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:49.889761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:49.890757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2357 sessionId:  describe result for acl check
2025-10-01T14:14:49.890792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:49.890793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:49.890795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:49.890801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256609266431452:6088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:49.891301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256609266431452:6088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:49.895653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256609266431452:6088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:49.904750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256609266431452:6088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:49.904769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256609266431452:6088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:49.904777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256609266431452:6088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:49.904787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:49.956268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:49.956617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:49.956813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:49.956817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:49.956830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:49.956872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:49.956911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256606889525717:8862]
2025-10-01T14:14:49.957529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:49.959672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:49.959736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:49.960085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:49.960133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.960135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.960136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.960137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.960139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.960140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.960141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.960143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.960144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.960145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.960147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.960148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.960149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.960150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.960157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.960167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.960171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.960174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.960178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.960181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.960185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.960188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.960192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.960197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.960200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.960203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.960207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.960211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.960219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.960227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:49.960233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.960238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:49.960242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.960247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:49.960252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.960257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:49.960262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.960267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:49.960272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.960276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:49.960281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.960286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:49.960290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.960295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:49.960300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.960305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:49.960309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.960314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.960319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.960324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.960328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.960333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.960338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.960343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:49.960348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.960354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:49.960395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:49.967417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:49.968641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:49.968647Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:49.968650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:49.968654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:49.968661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2356 [2:7556256606889525717:8862]
2025-10-01T14:14:49.968678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:49.968698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:49.968702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:49.968706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:49.968708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:49.968727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:49.968733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:49.968739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:49.968808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.968810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.968812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.968815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:49.968818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:49.968896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:49.968899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:49.968912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:49.968922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:49.968937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:49.968954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:49.968958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:49.968960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:49.968972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:49.968985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:49.969000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:49.969004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:49.969046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:49.969049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:49.969737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2356
2025-10-01T14:14:49.969795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2356
2025-10-01T14:14:49.969346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:49.969351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:49.969353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:49.969358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:49.971803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256609266431758:7265]
2025-10-01T14:14:49.974618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2356, pipe: [1:7556256609266431758:7265]
2025-10-01T14:14:49.975151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431435:2446], now have 1 active actors on pipe
2025-10-01T14:14:49.975167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431575:6088], now have 1 active actors on pipe
2025-10-01T14:14:49.975204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.975212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.975231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256609266431758:7265], now have 1 active actors on pipe
2025-10-01T14:14:49.975254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:49.975267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:49.975275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:49.975279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:49.975296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:49.975316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:49.975342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:49.975702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:49.975708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:49.975724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:49.975861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2357 partition: 0 MaxSeqNo: 45 sessionId: src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0
2025-10-01T14:14:49.978600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93bcfbb-bc1f472a-ca0b1781-fcd09a9b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:49.982291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Write session: try to update token
2025-10-01T14:14:49.982316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:50.021589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:50.021607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:50.021610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:50.021612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:50.021622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:50.021628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:50.021632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256606889525711:8862]
2025-10-01T14:14:50.021684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:50.021692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.021695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:50.021857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:50.022799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:50.022812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:50.022816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:50.032674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId: src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:50.035951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:50.192030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:50.192324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.192334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.192865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:50.193169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:50.193186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:50.193242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2357 reason: error at write: Disconnected sessionId: src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0
2025-10-01T14:14:50.193425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2357 sessionId: src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0 is DEAD
2025-10-01T14:14:50.193563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256609266431758:7265]
2025-10-01T14:14:50.193584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:50.194466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:50.194479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Write session will restart in 0.009131s
2025-10-01T14:14:50.194507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Write session: Do CDS request
2025-10-01T14:14:50.194517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:50.205534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.207095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:50.207112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2358
2025-10-01T14:14:50.207290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.207317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:50.207322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:50.207326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:50.207778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2358 sessionId:  describe result for acl check
2025-10-01T14:14:50.207801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:50.207803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:50.207804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:50.207809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256613561399128:6060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:50.208316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256613561399128:6060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:50.215850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256613561399128:6060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:50.218954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256613561399128:6060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:50.218971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256613561399128:6060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:50.218974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256613561399128:6060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:50.218983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:50.226625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:50.228245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:50.228482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:50.228493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:50.228506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:50.228571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:50.228618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256611184493215:8863]
2025-10-01T14:14:50.229048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:50.229456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:50.229503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:50.229838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:50.229919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.229921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.229922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.229923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.229924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.229926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.229927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.229929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.229930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.229931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.229932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.229933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.229935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.229936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.229942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.229953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.229957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.229961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.229964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.229968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.229971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.229974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.229978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.229982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.229985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.229988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.229992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.229995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.230003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.230010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.230016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.230021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.230025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.230031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.230035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.230039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.230044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.230049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.230053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.230057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.230063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.230068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.230072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.230077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.230083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.230090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.230094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.230098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.230102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.230107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.230111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.230115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.230119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.230123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.230127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.230132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.230174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:50.235568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:50.236384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:50.236389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:50.236391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:50.236395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:50.236402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2357 [2:7556256611184493215:8863]
2025-10-01T14:14:50.236419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:50.236437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:50.236441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.236445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.236447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.236462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:50.236468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:50.236473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:50.236530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.236532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.236534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.236537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:50.236540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:50.236624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:50.236626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.236638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.236648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.236663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:50.236680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.236683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.236685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.236697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:50.236711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:50.236724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:50.236727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:50.236767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.236769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:50.236984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:50.236988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:50.236991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:50.236996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:50.237722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2357
2025-10-01T14:14:50.237753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2357
2025-10-01T14:14:50.240715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399331:6060], now have 1 active actors on pipe
2025-10-01T14:14:50.240724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399076:2446], now have 1 active actors on pipe
2025-10-01T14:14:50.240742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.240750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.240789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:50.240800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.240805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.240809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:50.240821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.240837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:50.240858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.241295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.241300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.241315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.241444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2358 partition: 0 MaxSeqNo: 45 sessionId: src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0
2025-10-01T14:14:50.249951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c5b5eb-5e2bf44-ec776c79-9565c3ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:50.253349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Write session: try to update token
2025-10-01T14:14:50.253380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:50.271323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:50.271341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:50.271344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:50.271347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:50.271360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.271371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.271375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256611184493209:8863]
2025-10-01T14:14:50.271434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:50.271442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.271445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:50.271615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:50.272640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:50.272648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:50.272652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:50.294947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256613561399401:7265]
2025-10-01T14:14:50.295114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId: src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:50.300981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:50.301095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2357, pipe: [1:7556256613561399401:7265]
2025-10-01T14:14:50.431622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:50.432177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399401:7265], now have 1 active actors on pipe
2025-10-01T14:14:50.432217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.432230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.433242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256613561399401:7265]
2025-10-01T14:14:50.433284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:50.433286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:50.433342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2358 reason: error at write: Disconnected sessionId: src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0
2025-10-01T14:14:50.433545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2358 sessionId: src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0 is DEAD
2025-10-01T14:14:50.433689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:50.433725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:50.433736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Write session will restart in 0.007238s
2025-10-01T14:14:50.433765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Write session: Do CDS request
2025-10-01T14:14:50.433773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:50.433208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:50.442913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.443090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:50.443108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2359
2025-10-01T14:14:50.443246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.443287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:50.443293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:50.443297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:50.443781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2359 sessionId:  describe result for acl check
2025-10-01T14:14:50.443836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:50.443844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:50.443846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:50.443851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256613561399417:6018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:50.444597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256613561399417:6018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:50.453444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256613561399417:6018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:50.462116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256613561399417:6018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:50.462134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256613561399417:6018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:50.462137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256613561399417:6018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:50.462144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:50.468635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:50.471110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:50.471442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:50.471450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:50.471473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:50.471563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:50.471632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256611184493411:8841]
2025-10-01T14:14:50.472333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:50.472876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:50.472928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:50.473272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:50.473390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.473398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.473400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.473401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.473402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.473404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.473405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.473406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.473408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.473409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.473410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.473412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.473412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.473414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.473422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.473434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.473437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.473441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.473446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.473450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.473454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.473458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.473462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.473483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.473488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.473492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.473496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.473499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.473510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.473519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.473527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.473534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.473541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.473545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.473550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.473556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.473560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.473564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.473568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.473572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.473578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.473582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.473587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.473591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.473595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.473599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.473604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.473608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.473613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.473617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.473623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.473627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.473632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.473636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.473641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.473645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.473682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:50.478052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:50.478893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:50.478906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:50.478908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:50.478911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:50.478917Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2358 [2:7556256611184493411:8841]
2025-10-01T14:14:50.478929Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:50.478943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:50.478949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.478952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.478954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.478967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:50.478971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:50.478976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:50.479020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.479026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.479029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.479032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:50.479034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:50.479104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:50.479111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.479121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.479131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.479141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:50.479157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.479162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.479163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.479176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:50.479188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:50.479197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:50.479199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:50.479230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.479234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:50.479235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:50.479238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:50.479240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:50.479247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:50.479449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399404:2446], now have 1 active actors on pipe
2025-10-01T14:14:50.479457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399646:6018], now have 1 active actors on pipe
2025-10-01T14:14:50.479560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.479571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.479437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2358
2025-10-01T14:14:50.479598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:50.479608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.479612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.479615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:50.479625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.479635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:50.479441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2358
2025-10-01T14:14:50.479655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.479849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.479858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.479876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.479971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2359 partition: 0 MaxSeqNo: 45 sessionId: src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0
2025-10-01T14:14:50.480763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945df848-dabf9fb9-af7b24a1-f4ae4fad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:50.485272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Write session: try to update token
2025-10-01T14:14:50.485293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:50.495664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:50.495682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:50.495691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.495738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:50.495739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:50.495927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:50.496078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:50.496220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:50.496374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:50.496599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:50.496648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:50.509655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId: src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:50.512134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:50.512390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.512418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.512454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:50.512541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:50.521412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:50.521435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:50.521438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:50.521440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:50.521452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.521460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.521464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256611184493406:8841]
2025-10-01T14:14:50.521516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:50.521520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:50.521522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:50.521525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:50.521528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.521531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:50.521692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:50.533444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256613561399723:7265]
2025-10-01T14:14:50.533741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2358, pipe: [1:7556256613561399723:7265]
2025-10-01T14:14:50.683238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:50.683805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399723:7265], now have 1 active actors on pipe
2025-10-01T14:14:50.693401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.693436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.693621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.693698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.693778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.693850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.694536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.694551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.694637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.694708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.694777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.694853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.694902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.694910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.694978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.695041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.695105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.695170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.695219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.695227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.695296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.695364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.695434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.695500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.695547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.695555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.695618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.695678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.695745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.695815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.695868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.695876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.695974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.696057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.696138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.696219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.696277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.696285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.696372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.696450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.696543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.696636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.696691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.696698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.696789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.696873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.696962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.697046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.697109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.697116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.697206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.697282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.697361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.697437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.697492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.697500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.697590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.697665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.697744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.697825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.697881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.697888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.698230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:50.698250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:50.698268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256613561399723:7265]
2025-10-01T14:14:50.698281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2359 reason: error at write: Disconnected sessionId: src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0
2025-10-01T14:14:50.698317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:50.698502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2359 sessionId: src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0 is DEAD
2025-10-01T14:14:50.698619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:50.698630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Write session will restart in 0.008954s
2025-10-01T14:14:50.698657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Write session: Do CDS request
2025-10-01T14:14:50.698664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:50.698707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:50.708930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.708962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:50.708981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2360
2025-10-01T14:14:50.709163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.709208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:50.709217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:50.709221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:50.709645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2360 sessionId:  describe result for acl check
2025-10-01T14:14:50.709677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:50.709683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:50.709685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:50.709689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256613561399906:5992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:50.710132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256613561399906:5992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:50.713382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:50.714565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:50.714743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:50.714751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:50.714759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:50.714795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:50.714825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256611184493646:8839]
2025-10-01T14:14:50.715252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:50.715245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256613561399906:5992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:50.715474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:50.715501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:50.715700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:50.715736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.715740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.715741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.715741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.715742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.715742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.715743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.715744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.715744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.715745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.715745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.715746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.715747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.715747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.715750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.715756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.715758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.715760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.715762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.715764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.715766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.715768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.715770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.715773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.715775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.715777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.715779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.715781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.715785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.715790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.715794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.715797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.715800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.715802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.715805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.715808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.715811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.715815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.715818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.715821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.715823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.715826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.715828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.715831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.715835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.715838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.715840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.715843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.715846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.715848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.715850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.715853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.715855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.715858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.715860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.715863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.715884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:50.719834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256613561399906:5992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:50.719855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256613561399906:5992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:50.719859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256613561399906:5992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:50.719867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:50.720041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:50.720815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:50.720825Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:50.720827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:50.720830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:50.720835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2359 [2:7556256611184493646:8839]
2025-10-01T14:14:50.720847Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:50.720860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:50.720864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.720867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.720868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.720881Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:50.720887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:50.720892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:50.720945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.720952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.720954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.720957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:50.720960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:50.721034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:50.721041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.721052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.721063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.721078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:50.721096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561400041:5992], now have 1 active actors on pipe
2025-10-01T14:14:50.721102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561399731:2446], now have 1 active actors on pipe
2025-10-01T14:14:50.721109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.721110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.721111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.721122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:50.721136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:50.721136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:50.721139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:50.721141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:50.721148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:50.721150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:50.721141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2359
2025-10-01T14:14:50.721176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.721157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2359
2025-10-01T14:14:50.721183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:50.721184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:50.721199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.721204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.721249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f576ef89-848c1911-f818a059-14b625c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:50.721259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.721262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.721264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:50.721274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.721287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:50.721311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.721472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.721482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.721505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.721582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2360 partition: 0 MaxSeqNo: 45 sessionId: src_id|f576ef89-848c1911-f818a059-14b625c9_0
2025-10-01T14:14:50.721948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114435d6-6ba9c9c3-cae6f0b2-9a213a75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f576ef89-848c1911-f818a059-14b625c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:50.724884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Write session: try to update token
2025-10-01T14:14:50.724903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:50.740102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId: src_id|f576ef89-848c1911-f818a059-14b625c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:50.742680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:50.742886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.742907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.742948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:50.743034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:50.745914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:50.745931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:50.745934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:50.745936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:50.745947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.745951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.745955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256611184493641:8839]
2025-10-01T14:14:50.746004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:50.746008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:50.746014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:50.746016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.746018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:50.746019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:50.746181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:50.779173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:14:50.779202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-01T14:14:50.798093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256613561400052:7265]
2025-10-01T14:14:50.798361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2359, pipe: [1:7556256613561400052:7265]
2025-10-01T14:14:50.901665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:50.913098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.913127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.913321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.913400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.913478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.913555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.913610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.913628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.913715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.913786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.913855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.913929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.913975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.913979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.914054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.914118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.914184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.914249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.914292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.914296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.914389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.914454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.914521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.914596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.914643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.914650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.914720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.914787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.914860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.914941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.914994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.915002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.915096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.915173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.915257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.915342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.915401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.915410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.915504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.915591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.915685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.915769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.915835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.915848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.915940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.916029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.916117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.916205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.916264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.916275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.916363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.916445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.916530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.916629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.916694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.916702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.916801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.916885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.916972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.917059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.917117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.917125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.917235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561400052:7265], now have 1 active actors on pipe
2025-10-01T14:14:50.917674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:50.917695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:50.917738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2360 reason: error at write: Disconnected sessionId: src_id|f576ef89-848c1911-f818a059-14b625c9_0
2025-10-01T14:14:50.917838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256613561400052:7265]
2025-10-01T14:14:50.917872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:50.917890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-01T14:14:50.917927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2360 sessionId: src_id|f576ef89-848c1911-f818a059-14b625c9_0 is DEAD
2025-10-01T14:14:50.918081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:50.918091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Write session will restart in 0.007975s
2025-10-01T14:14:50.918121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Write session: Do CDS request
2025-10-01T14:14:50.918127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:50.918657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:50.926929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.927020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:50.927039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2361
2025-10-01T14:14:50.927140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:50.927174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:50.927184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:50.927191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:50.927625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2361 sessionId:  describe result for acl check
2025-10-01T14:14:50.927662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:50.927669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:50.927680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:50.927685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256613561400201:5984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:50.928279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256613561400201:5984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:50.930954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256613561400201:5984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:50.934035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256613561400201:5984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:50.934054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256613561400201:5984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:50.934058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256613561400201:5984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:50.934070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:50.935323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:50.937001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:50.937458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:50.937477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:50.937502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:50.937616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:50.937689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256611184493848:8832]
2025-10-01T14:14:50.938360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:50.939086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:50.939144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:50.939524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:50.939599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.939606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.939607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.939608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.939609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.939611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.939613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.939614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.939615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.939616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.939617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.939619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.939621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.939622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.939628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.939638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.939643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.939647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.939652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.939656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.939660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.939664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.939669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.939672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.939676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.939680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.939684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.939687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.939695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.939703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:50.939709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.939715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:50.939719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.939724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:50.939728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.939733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:50.939737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.939742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:50.939746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.939751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:50.939757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.939763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:50.939767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.939772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:50.939777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.939782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:50.939787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.939792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.939797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.939803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.939808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.939813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.939823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.939829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:50.939835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.939842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:50.939893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:50.944174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:50.944834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:50.944849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:50.944851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:50.944854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:50.944861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2360 [2:7556256611184493848:8832]
2025-10-01T14:14:50.944872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:50.944887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:50.944889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.944892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.944894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.944908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:50.944912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:50.944917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:50.944962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.944964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.944966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.944969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:50.944971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:50.945024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:50.945030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:50.945037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:50.945044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:50.945053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:50.945066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:50.945068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:50.945070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:50.945076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:50.945086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:50.945088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561400054:2446], now have 1 active actors on pipe
2025-10-01T14:14:50.945090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:50.945094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:50.945101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:50.945103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:50.945105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:50.945110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256613561400370:5984], now have 1 active actors on pipe
2025-10-01T14:14:50.945138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:50.945145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:50.945165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:50.945214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2360
2025-10-01T14:14:50.945237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2360
2025-10-01T14:14:50.945299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.945307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.945360Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:14:50.945390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d22238ec-267058a3-75a112f4-39db50ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:50.945399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:50.945404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:50.945406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:50.945415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:50.945421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:50.945435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.945558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 21 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:14:50.945598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:14:50.945605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.945614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.945629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:50.945707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2361 partition: 0 MaxSeqNo: 45 sessionId: src_id|d22238ec-267058a3-75a112f4-39db50ca_0
2025-10-01T14:14:50.946058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f576ef89-848c1911-f818a059-14b625c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d22238ec-267058a3-75a112f4-39db50ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:50.949224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Write session: try to update token
2025-10-01T14:14:50.949247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:50.957414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:50.957431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:50.957441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:50.957487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:50.957658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:50.957802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:50.957934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:50.957957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:50.958062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:50.958243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:50.958273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:50.964585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId: src_id|d22238ec-267058a3-75a112f4-39db50ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:50.967616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:50.967849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.967867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.967910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:50.968013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:50.997270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:50.997299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:50.997471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.997543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.997609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.997687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.997736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.997750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.997819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.997883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.997950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.998016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.998064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.998072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.998139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.998205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.998272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.998345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.998415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.998422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.998489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.998556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.998637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.998703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.998748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.998755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.998823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.998888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.998948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.999005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.999047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.999050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.999120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.999178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.999237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.999295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.999340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.999343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.999410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.999468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.999529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.999592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.999641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.999644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:50.999718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:50.999782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:50.999848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:50.999916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:50.999961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:50.999968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.000044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.000109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.000170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.000238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.000285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.000288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.000359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.000419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.000482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.000547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.000607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.000610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.000687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:51.000691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:51.000693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:51.000696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:51.000706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:51.000709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:51.000713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256611184493843:8832]
2025-10-01T14:14:51.000775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:14:51.000847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.000868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.000870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:14:51.000895Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000906Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000914Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000919Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000923Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000926Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000930Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000934Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000938Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.000942Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001249Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001255Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001259Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001262Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001266Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001272Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001275Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001280Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001285Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001289Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001292Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001297Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001300Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001303Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001307Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001716Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001721Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001725Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001729Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001732Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001737Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001742Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001749Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001752Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001756Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:14:51.001991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:14:51.002003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:14:51.002006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:14:51.002011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:14:51.002015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:14:51.002431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:51.002438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:51.002442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:51.002823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:14:51.002845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:14:51.002852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:14:51.002855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:14:51.002858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:14:51.002861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:14:51.003535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:14:51.003550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:14:51.003557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:14:51.003559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:14:51.003562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:14:51.003566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:14:51.004139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:14:51.004156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.004270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759328091003
2025-10-01T14:14:51.005108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:51.005124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.005128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:51.005273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:51.017757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256617856367686:7265]
2025-10-01T14:14:51.018034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2360, pipe: [1:7556256617856367686:7265]
2025-10-01T14:14:51.144477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:51.144906Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:14:51.144938Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:14:51.144962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856367686:7265], now have 1 active actors on pipe
2025-10-01T14:14:51.145125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:51.145221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:51.145241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:51.145279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2361 reason: error at write: Disconnected sessionId: src_id|d22238ec-267058a3-75a112f4-39db50ca_0
2025-10-01T14:14:51.145308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256617856367686:7265]
2025-10-01T14:14:51.145336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:51.145738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:51.145756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Write session will restart in 0.007327s
2025-10-01T14:14:51.145466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2361 sessionId: src_id|d22238ec-267058a3-75a112f4-39db50ca_0 is DEAD
2025-10-01T14:14:51.145785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Write session: Do CDS request
2025-10-01T14:14:51.145790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:51.154052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.154198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:51.154214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2362
2025-10-01T14:14:51.154348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.154431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:51.154441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:51.154457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:51.154849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2362 sessionId:  describe result for acl check
2025-10-01T14:14:51.154907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:51.154914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:51.154916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:51.154921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256617856367915:5972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:51.155453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256617856367915:5972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:51.157769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256617856367915:5972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:51.158033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:51.159781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:51.159958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:51.159969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:51.159981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:51.160036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:51.160078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256615479461341:8828]
2025-10-01T14:14:51.160171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256617856367915:5972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:51.160184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256617856367915:5972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:51.160187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256617856367915:5972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:51.160195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:51.160617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:51.160887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:51.160927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:51.161131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:51.161180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.161184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.161185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.161187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.161188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.161189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.161190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.161192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.161193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.161194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.161195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.161196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.161197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.161198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.161203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.161212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.161215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.161219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.161227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.161240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.161248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.161251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.161259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.161262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.161267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.161269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.161271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.161273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.161279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.161287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.161291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.161297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.161300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.161303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.161308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.161311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.161313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.161316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.161318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.161321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.161324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.161326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.161329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.161331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.161334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.161337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.161339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.161342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.161344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.161347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.161349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.161352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.161354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.161357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.161359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.161362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.161382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:51.165046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:51.165751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:51.165769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:51.165772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:51.165776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:51.165783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2361 [2:7556256615479461341:8828]
2025-10-01T14:14:51.165799Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:51.165815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:51.165818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.165822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.165825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.165841Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:51.165853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:51.165858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:51.165917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.165924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.165927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.165930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:51.165932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:51.166000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:51.166007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.166019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.166032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.166053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:51.166075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368000:5972], now have 1 active actors on pipe
2025-10-01T14:14:51.166083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856367692:2446], now have 1 active actors on pipe
2025-10-01T14:14:51.166091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.166093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.166096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.166110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:51.166125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:51.166127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:51.166133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:51.166135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:51.166141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:51.166145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:51.166148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2361
2025-10-01T14:14:51.166149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2361
2025-10-01T14:14:51.166180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.166188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:51.166190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:51.166205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.166215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.166263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|628fd133-692963db-68a21113-9200f804_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:51.166275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.166279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.166282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:51.166292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.166304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:51.166326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.166490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.166498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.166513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.166612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2362 partition: 0 MaxSeqNo: 45 sessionId: src_id|628fd133-692963db-68a21113-9200f804_0
2025-10-01T14:14:51.166967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22238ec-267058a3-75a112f4-39db50ca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|628fd133-692963db-68a21113-9200f804_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:51.169909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Write session: try to update token
2025-10-01T14:14:51.169928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:51.183368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId: src_id|628fd133-692963db-68a21113-9200f804_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:51.185842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:51.187599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.187615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.187632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:51.187635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:51.187637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:51.187638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:51.187644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.187647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.187651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256615479461336:8828]
2025-10-01T14:14:51.187686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:51.187693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:51.187696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:51.187699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.187698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:51.187700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:51.187817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:51.245080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256617856368024:7265]
2025-10-01T14:14:51.245302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2361, pipe: [1:7556256617856368024:7265]
2025-10-01T14:14:51.328503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:51.329071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:51.329129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368024:7265], now have 1 active actors on pipe
2025-10-01T14:14:51.329206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:51.329352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:51.329404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256617856368024:7265]
2025-10-01T14:14:51.340701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:51.340719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:51.340745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2362 reason: error at write: Disconnected sessionId: src_id|628fd133-692963db-68a21113-9200f804_0
2025-10-01T14:14:51.340902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2362 sessionId: src_id|628fd133-692963db-68a21113-9200f804_0 is DEAD
2025-10-01T14:14:51.341028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:51.341046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Write session will restart in 0.005522s
2025-10-01T14:14:51.341070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Write session: Do CDS request
2025-10-01T14:14:51.341077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:51.346853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:51.347920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.348039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:51.348065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2363
2025-10-01T14:14:51.348113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:51.348183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.348207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:51.348214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:51.348216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:51.348297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:51.348306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:51.348317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:51.348361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:51.348402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256615479461548:8819]
2025-10-01T14:14:51.348612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2363 sessionId:  describe result for acl check
2025-10-01T14:14:51.348648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:51.348650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:51.348652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:51.348656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256617856368311:5953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:51.348985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:51.349169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256617856368311:5953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:51.349321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:51.349366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:51.349674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:51.349718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.349722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.349723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.349724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.349724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.349725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.349726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.349727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.349728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.349729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.349729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.349730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.349731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.349731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.349735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.349740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.349742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.349745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.349747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.349749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.349751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.349753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.349755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.349758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.349760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.349762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.349765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.349767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.349771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.349775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.349781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.349787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.349791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.349795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.349799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.349803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.349808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.349812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.349815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.349819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.349823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.349827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.349831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.349836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.349841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.349845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.349848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.349853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.349858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.349862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.349865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.349868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.349871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.349873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.349876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.349879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.349912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:51.351785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256617856368311:5953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:51.353389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:51.353996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:51.354010Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:51.354012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:51.354016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:51.354022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2362 [2:7556256615479461548:8819]
2025-10-01T14:14:51.354040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:51.354058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:51.354064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.354067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.354069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.354083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:51.354092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:51.354102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:51.354154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.354164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.354166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.354169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:51.354171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:51.354235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:51.354241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.354250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.354263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.354279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:51.354298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368036:2446], now have 1 active actors on pipe
2025-10-01T14:14:51.354309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.354310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.354313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.354323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:51.354338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:51.354349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:51.354355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:51.354357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:51.354359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:51.354362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:51.354334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2362
2025-10-01T14:14:51.354404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.354414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:51.354430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:51.354646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256617856368311:5953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:51.354658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256617856368311:5953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:51.354660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256617856368311:5953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:51.354665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:51.354839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368351:5953], now have 1 active actors on pipe
2025-10-01T14:14:51.354864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2362
2025-10-01T14:14:51.354908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.354917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.354938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:51.354949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.354957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.354960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:51.354969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.354981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:51.354998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.355126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.355132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.355143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.355208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2363 partition: 0 MaxSeqNo: 45 sessionId: src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0
2025-10-01T14:14:51.355540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628fd133-692963db-68a21113-9200f804_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:51.358344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Write session: try to update token
2025-10-01T14:14:51.358358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:51.370205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:51.370218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:51.370226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.370271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:51.370277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:51.370457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:51.370595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:51.370724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:51.370852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:51.371106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:51.371140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:51.372577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId: src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:51.375331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:51.375539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.375560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.375595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:51.375685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:51.383424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:51.383440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:51.383442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:51.383444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:51.383454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.383459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.383463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256615479461543:8819]
2025-10-01T14:14:51.383509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:51.383519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:51.383521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.383524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:51.383529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:51.383532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:51.383649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:51.429429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256617856368357:7265]
2025-10-01T14:14:51.429762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2362, pipe: [1:7556256617856368357:7265]
2025-10-01T14:14:51.534160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:51.542004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.542028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.542187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.542240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.542297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.542357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.542422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.542427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.542494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.542563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.542621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.542679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.542720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.542723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.542789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.542846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.542911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.542970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.543014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.543018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.543087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.543146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.543209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.543263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.543303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.543306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.543370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.543436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.543494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.543556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.543594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.543596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.543663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.543727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.543785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.543845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.543888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.543892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.543964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.544022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.544088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.544155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.544199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.544202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.544287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.544350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.544416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.544480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.544525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.544529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.544624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.544689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.544753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.544815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.544858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.544861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.544934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:51.544994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:51.545431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:51.545868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:51.546046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:51.546051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:51.546135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368357:7265], now have 1 active actors on pipe
2025-10-01T14:14:51.546440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:51.546458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:51.546483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:51.546488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2363 reason: error at write: Disconnected sessionId: src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0
2025-10-01T14:14:51.546533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256617856368357:7265]
2025-10-01T14:14:51.546714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2363 sessionId: src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0 is DEAD
2025-10-01T14:14:51.547169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:51.547185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Write session will restart in 0.009440s
2025-10-01T14:14:51.547210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Write session: Do CDS request
2025-10-01T14:14:51.547215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:51.547437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:51.558117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.558256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:51.558273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2364
2025-10-01T14:14:51.558504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.558545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:51.558551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:51.558555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:51.558932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2364 sessionId:  describe result for acl check
2025-10-01T14:14:51.559034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:51.559037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:51.559040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:51.559046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256617856368451:5947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:51.559482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256617856368451:5947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:51.565838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256617856368451:5947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:51.568969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256617856368451:5947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:51.568985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256617856368451:5947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:51.568988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256617856368451:5947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:51.568997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:51.570498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:51.571601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:51.571802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:51.571815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:51.571827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:51.571891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:51.571931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256615479461775:8818]
2025-10-01T14:14:51.572458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:51.572752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:51.572788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:51.572988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:51.573027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.573031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.573032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.573033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.573033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.573034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.573035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.573035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.573036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.573036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.573037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.573037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.573038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.573038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.573041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.573047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.573049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.573052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.573054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.573056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.573058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.573060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.573062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.573064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.573066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.573068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.573070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.573072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.573080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.573090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.573094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.573097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.573099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.573102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.573104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.573107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.573109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.573112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.573114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.573117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.573119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.573122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.573124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.573127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.573130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.573133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.573135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.573138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.573140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.573143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.573145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.573148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.573150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.573152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.573154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.573157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.573175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:51.577119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:51.578034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:51.578049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:51.578053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:51.578057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:51.578063Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2363 [2:7556256615479461775:8818]
2025-10-01T14:14:51.578082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:51.578097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:51.578106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.578110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.578111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.578128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:51.578137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:51.578142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:51.578200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.578207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.578209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.578212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:51.578214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:51.578285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:51.578292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.578304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.578314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.578329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:51.578348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368363:2446], now have 1 active actors on pipe
2025-10-01T14:14:51.578357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368670:5947], now have 1 active actors on pipe
2025-10-01T14:14:51.578364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.578366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.578368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.578408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:51.578420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:51.578425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:51.578430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:51.578434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:51.578440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:51.578442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:51.578471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.578440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2363
2025-10-01T14:14:51.578482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:51.578501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:51.578442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2363
2025-10-01T14:14:51.578638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.578646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.578672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5047afb5-85192f30-a7e3053e-245b5251_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:51.578683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.578687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.578691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:51.578700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.578713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:51.578730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.578888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.578896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.578908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.579007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2364 partition: 0 MaxSeqNo: 45 sessionId: src_id|5047afb5-85192f30-a7e3053e-245b5251_0
2025-10-01T14:14:51.582500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158aa45-fd7d18f2-47ee44da-7789b2ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5047afb5-85192f30-a7e3053e-245b5251_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:51.585680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Write session: try to update token
2025-10-01T14:14:51.585704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:51.602717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:51.602734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:51.602737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:51.602739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:51.602748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.602753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.602758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256615479461770:8818]
2025-10-01T14:14:51.602805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:51.602807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:51.602810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:51.602814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:51.602814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.602816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:51.602995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:51.614126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId: src_id|5047afb5-85192f30-a7e3053e-245b5251_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:51.617264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:51.646510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256617856368690:7265]
2025-10-01T14:14:51.646825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2363, pipe: [1:7556256617856368690:7265]
2025-10-01T14:14:51.758650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:51.758984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.758999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.759023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368690:7265], now have 1 active actors on pipe
2025-10-01T14:14:51.759273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:51.759290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256617856368690:7265]
2025-10-01T14:14:51.759319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:51.759356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:51.759418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5047afb5-85192f30-a7e3053e-245b5251_0
2025-10-01T14:14:51.759603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2364 sessionId: src_id|5047afb5-85192f30-a7e3053e-245b5251_0 is DEAD
2025-10-01T14:14:51.760006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:51.760019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Write session will restart in 0.005927s
2025-10-01T14:14:51.760046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Write session: Do CDS request
2025-10-01T14:14:51.760051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:51.769680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.770735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:51.770755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2365
2025-10-01T14:14:51.770905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.770948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:51.770953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:51.770957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:51.771438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2365 sessionId:  describe result for acl check
2025-10-01T14:14:51.771477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:51.771483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:51.771485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:51.771494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256617856368798:5933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:51.772058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256617856368798:5933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:51.774513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256617856368798:5933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:51.777373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256617856368798:5933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:51.777391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256617856368798:5933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:51.777395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256617856368798:5933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:51.777402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:51.782822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:51.783308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:51.783438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:51.783441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:51.783448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:51.783478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:51.783507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256615479461994:8799]
2025-10-01T14:14:51.783948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:51.784695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:51.784726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:51.785054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:51.785093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.785094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.785095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.785095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.785096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.785097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.785097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.785098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.785099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.785101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.785101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.785102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.785103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.785104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.785107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.785114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.785116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.785119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.785121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.785123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.785126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.785128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.785130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.785133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.785135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.785137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.785139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.785142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.785158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.785163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.785167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.785171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.785173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.785177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.785180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.785183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.785186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.785189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.785192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.785197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.785202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.785207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.785211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.785216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.785222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.785225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.785227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.785230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.785233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.785236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.785238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.785242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.785244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.785247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.785249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.785252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.785274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:51.790293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2364
2025-10-01T14:14:51.790329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2364
2025-10-01T14:14:51.788980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:51.789715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:51.789719Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:51.789721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:51.789724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:51.789729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2364 [2:7556256615479461994:8799]
2025-10-01T14:14:51.789741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:51.789755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:51.789757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.789759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.789760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.789772Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:51.789777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:51.789781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:51.789831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.789835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.789836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.789840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:51.789842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:51.789898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:51.789900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.789907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.789912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.789922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:51.789935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368692:2446], now have 1 active actors on pipe
2025-10-01T14:14:51.789943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.789945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.789947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.789960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:51.789968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:51.789970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856368970:5933], now have 1 active actors on pipe
2025-10-01T14:14:51.789970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:51.789972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:51.789978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:51.789990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:51.789993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:51.790020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.790025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:51.790055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:51.790413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.790432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.790462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:51.790471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.790475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.790478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:51.790488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.790498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:51.790516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.790826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2365 partition: 0 MaxSeqNo: 45 sessionId: src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0
2025-10-01T14:14:51.791208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5047afb5-85192f30-a7e3053e-245b5251_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:51.790727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.790737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.790756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.794712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Write session: try to update token
2025-10-01T14:14:51.794733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:51.812482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:51.812502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:51.812504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:51.812506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:51.812518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.812523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.812529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256615479461986:8799]
2025-10-01T14:14:51.812589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:51.812596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.812596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:51.812599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:51.812603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:51.812608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:51.812750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:51.815006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId: src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:51.818108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:51.859521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256617856369015:7265]
2025-10-01T14:14:51.859856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2364, pipe: [1:7556256617856369015:7265]
2025-10-01T14:14:51.958274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:51.958937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.958950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.958985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856369015:7265], now have 1 active actors on pipe
2025-10-01T14:14:51.959185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:51.959293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:51.959296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256617856369015:7265]
2025-10-01T14:14:51.959319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:51.959326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:51.959401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2365 reason: error at write: Disconnected sessionId: src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0
2025-10-01T14:14:51.959556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2365 sessionId: src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0 is DEAD
2025-10-01T14:14:51.959720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:51.959733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Write session will restart in 0.006818s
2025-10-01T14:14:51.959763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Write session: Do CDS request
2025-10-01T14:14:51.959768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:51.967874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.967936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:51.967959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2366
2025-10-01T14:14:51.968205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:51.968261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:51.968275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:51.968279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:51.968739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2366 sessionId:  describe result for acl check
2025-10-01T14:14:51.968773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:51.968779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:51.968781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:51.968787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256617856369140:5914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:51.969316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256617856369140:5914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:51.971633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256617856369140:5914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:51.974786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256617856369140:5914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:51.974809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256617856369140:5914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:51.974813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256617856369140:5914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:51.974821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:51.977906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:51.979788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:51.979990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:51.980000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:51.980011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:51.980062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:51.980109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256615479462195:8796]
2025-10-01T14:14:51.980825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:51.981281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:51.981339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:51.981715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:51.981793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.981799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.981801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.981802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.981804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.981806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.981807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.981808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.981810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.981811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.981812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.981814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.981815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.981816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.981822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.981832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.981836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.981839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.981843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.981846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.981851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.981854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.981858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.981862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.981865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.981869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.981872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.981875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.981883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.981891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:51.981898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.981903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:51.981907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.981912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:51.981917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.981923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:51.981928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.981933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:51.981938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.981944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:51.981949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.981954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:51.981958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.981964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:51.981970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.981977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:51.981986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.981991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.982005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.982009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.982014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.982020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.982026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.982031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:51.982035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.982040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:51.982080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:51.986850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:51.987587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:51.987606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:51.987610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:51.987615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:51.987623Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2365 [2:7556256615479462195:8796]
2025-10-01T14:14:51.987650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:51.987671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:51.987676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.987680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.987682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.987700Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:51.987705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:51.987713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:51.987791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.987794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.987796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.987799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:51.987802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:51.987892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:51.987896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:51.987909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:51.987919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:51.987935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:51.987959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856369322:5914], now have 1 active actors on pipe
2025-10-01T14:14:51.987966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:51.987968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:51.987972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:51.987992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:51.988008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256617856369032:2446], now have 1 active actors on pipe
2025-10-01T14:14:51.988015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:51.988024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:51.988028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:51.988029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:51.988032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:51.988032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:51.988075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:51.988085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:51.988091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:51.988386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2365
2025-10-01T14:14:51.988429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2365
2025-10-01T14:14:51.988456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.988466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.988492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:51.988500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:51.988504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:51.988506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:51.988516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:51.988527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:51.988564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.989133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2366 partition: 0 MaxSeqNo: 45 sessionId: src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0
2025-10-01T14:14:51.988908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:51.988923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:51.988946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:51.989535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22170aa-3114569e-a1c5643e-ed98f0ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:51.992445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Write session: try to update token
2025-10-01T14:14:51.992462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:52.011204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:52.011227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:52.011230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:52.011232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:52.011242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:52.011247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:52.011251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256615479462190:8796]
2025-10-01T14:14:52.011303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:52.011306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:52.011314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:52.011314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.011317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:52.011316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:52.011457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:52.010209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId: src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:52.013199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:52.059694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256622151336651:7265]
2025-10-01T14:14:52.060003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2365, pipe: [1:7556256622151336651:7265]
2025-10-01T14:14:52.156776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:52.157148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.157160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.157195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151336651:7265], now have 1 active actors on pipe
2025-10-01T14:14:52.157467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:52.157481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:52.157484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:52.157522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256622151336651:7265]
2025-10-01T14:14:52.157553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2366 reason: error at write: Disconnected sessionId: src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0
2025-10-01T14:14:52.157576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:52.157700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2366 sessionId: src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0 is DEAD
2025-10-01T14:14:52.157810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:52.157815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Write session will restart in 0.005264s
2025-10-01T14:14:52.157836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Write session: Do CDS request
2025-10-01T14:14:52.157841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:52.163894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.163968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:52.163986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2367
2025-10-01T14:14:52.164105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.164138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:52.164149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:52.164153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:52.164533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2367 sessionId:  describe result for acl check
2025-10-01T14:14:52.164578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:52.164585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:52.164587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:52.164592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256622151336723:5892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:52.165132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256622151336723:5892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:52.167021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256622151336723:5892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:52.169346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256622151336723:5892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:52.169359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256622151336723:5892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:52.169364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256622151336723:5892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:52.169371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:52.169956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:52.171111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:52.171238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:52.171245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:52.171252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:52.171281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:52.171306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256619774429693:8794]
2025-10-01T14:14:52.171681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:52.171916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:52.171947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:52.172150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:52.172187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.172188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.172188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.172189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.172189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.172190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.172191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.172191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.172192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.172193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.172193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.172194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.172194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.172195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.172198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.172203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.172206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.172208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.172210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.172212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.172214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.172216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.172218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.172220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.172222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.172224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.172226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.172228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.172233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.172237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.172241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.172244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.172246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.172249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.172252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.172254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.172258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.172261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.172263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.172265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.172268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.172271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.172273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.172276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.172278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.172281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.172283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.172286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.172288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.172291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.172293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.172295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.172298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.172300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.172303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.172305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.172325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:52.175978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:52.176605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:52.176617Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:52.176619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:52.176622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:52.176628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2366 [2:7556256619774429693:8794]
2025-10-01T14:14:52.176640Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:52.176654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:52.176657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.176659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.176662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.176674Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:52.176678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:52.176682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:52.176730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.176736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.176738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.176740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:52.176742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:52.176903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:52.176910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.176918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.176924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.176935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:52.176949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151336968:5892], now have 1 active actors on pipe
2025-10-01T14:14:52.176955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151336657:2446], now have 1 active actors on pipe
2025-10-01T14:14:52.176960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.176962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.176964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.176973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:52.176950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2366
2025-10-01T14:14:52.176979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2366
2025-10-01T14:14:52.176984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:52.176999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:52.177004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:52.177006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:52.177006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:52.177009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:52.177036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.177038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:52.177040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:52.177055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.177063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.177098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:52.177107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.177112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.177114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:52.177123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.177135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:52.177154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.177309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.177316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.177329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.177401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2367 partition: 0 MaxSeqNo: 45 sessionId: src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0
2025-10-01T14:14:52.177712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c669c4df-4a35d725-e6059d11-2bcde3fc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:52.181014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Write session: try to update token
2025-10-01T14:14:52.181031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:52.199614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:52.199634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:52.199637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:52.199639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:52.199651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.199656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.199661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256619774429688:8794]
2025-10-01T14:14:52.199716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:52.199715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:52.199722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:52.199726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:52.199727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.199730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:52.199980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:52.201521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId: src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:52.204742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:52.257974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256622151336985:7265]
2025-10-01T14:14:52.258273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2366, pipe: [1:7556256622151336985:7265]
2025-10-01T14:14:52.354920Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:52.355512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.355528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.355570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151336985:7265], now have 1 active actors on pipe
2025-10-01T14:14:52.355773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:52.355865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:52.355884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:52.355891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:52.355937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256622151336985:7265]
2025-10-01T14:14:52.355943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2367 reason: error at write: Disconnected sessionId: src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0
2025-10-01T14:14:52.356114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2367 sessionId: src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0 is DEAD
2025-10-01T14:14:52.356286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:52.356299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Write session will restart in 0.007742s
2025-10-01T14:14:52.356324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Write session: Do CDS request
2025-10-01T14:14:52.356330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:52.365196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.365285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:52.365313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2368
2025-10-01T14:14:52.365430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.365459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:52.365465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:52.365470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:52.365987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2368 sessionId:  describe result for acl check
2025-10-01T14:14:52.366025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:52.366028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:52.366030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:52.366035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256622151337215:5868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:52.366691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256622151337215:5868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:52.369490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256622151337215:5868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:52.369420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:52.370578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:52.370747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:52.370751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:52.370761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:52.370807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:52.370837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256619774429904:8786]
2025-10-01T14:14:52.371530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:52.371801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:52.371834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:52.372029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:52.372075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.372079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.372080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.372081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.372081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.372082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.372083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.372083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.372084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.372084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.372085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.372086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.372086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.372087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.372090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.372096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.372098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.372100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.372102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.372104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.372106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.372109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.372113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.372116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.372119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.372123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.372127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.372130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.372136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.372143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.372147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.372150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.372153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.372156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.372158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.372161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.372163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.372166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.372169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.372171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.372174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.372177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.372179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.372143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256622151337215:5868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:52.372181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.372165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256622151337215:5868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:52.372184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.372169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256622151337215:5868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:52.372187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.372176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:52.372189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.372191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.372194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.372197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.372200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.372202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.372205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.372207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.372210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.372212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.372233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:52.375704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:52.376317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:52.376329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:52.376331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:52.376335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:52.376341Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2367 [2:7556256619774429904:8786]
2025-10-01T14:14:52.376356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:52.376376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:52.376383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.376386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.376388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.376404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:52.376413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:52.376419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:52.376472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.376481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.376483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.376486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:52.376489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:52.376547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:52.376562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.376572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.376583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.376603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:52.376626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337321:5868], now have 1 active actors on pipe
2025-10-01T14:14:52.376633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.376639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.376642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.376655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:52.376665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:52.376668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337008:2446], now have 1 active actors on pipe
2025-10-01T14:14:52.376669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:52.376671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:52.376675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:52.376688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:52.376690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:52.376716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.376723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:52.376734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:52.376757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.376702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2367
2025-10-01T14:14:52.376765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.376708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2367
2025-10-01T14:14:52.376794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:52.376805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.376809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.376811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:52.376820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.376833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:52.376861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.376995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.377003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.377017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.377103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2368 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0
2025-10-01T14:14:52.377460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543a5ff7-3a596814-18beaa69-c63f48b6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:52.380417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Write session: try to update token
2025-10-01T14:14:52.380435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:52.397028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId: src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:52.397547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:52.397571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:52.397573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:52.397576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:52.397585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.397591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.397595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256619774429899:8786]
2025-10-01T14:14:52.397650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:52.397657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.397660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:52.397799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:52.399580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:52.399804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:52.399821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:52.399824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:52.455994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256622151337330:7265]
2025-10-01T14:14:52.456305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2367, pipe: [1:7556256622151337330:7265]
2025-10-01T14:14:52.546681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:52.547496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.547517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.547565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337330:7265], now have 1 active actors on pipe
2025-10-01T14:14:52.548006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:52.547960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:52.548024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256622151337330:7265]
2025-10-01T14:14:52.548043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:52.548046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:52.548102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2368 reason: error at write: Disconnected sessionId: src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0
2025-10-01T14:14:52.548263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2368 sessionId: src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0 is DEAD
2025-10-01T14:14:52.553417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:52.553430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Write session will restart in 0.006416s
2025-10-01T14:14:52.553461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Write session: Do CDS request
2025-10-01T14:14:52.553467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:52.560932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.561063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:52.561085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2369
2025-10-01T14:14:52.561233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.561272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:52.561286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:52.561291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:52.561954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2369 sessionId:  describe result for acl check
2025-10-01T14:14:52.562009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:52.562015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:52.562018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:52.562027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256622151337458:5860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:52.562607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256622151337458:5860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:52.565393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256622151337458:5860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:52.571343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256622151337458:5860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:52.571365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256622151337458:5860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:52.571369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256622151337458:5860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:52.571380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:52.573799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:52.575302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:52.575503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:52.575513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:52.575526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:52.575572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:52.575609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256619774430123:8783]
2025-10-01T14:14:52.576264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:52.576547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:52.576594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:52.576887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:52.576937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.576941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.576942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.576943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.576945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.576946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.576947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.576949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.576950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.576951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.576953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.576954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.576955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.576956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.576960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.576969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.576972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.576975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.576979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.576982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.576986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.576989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.576993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.576996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.577000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.577003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.577006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.577009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.577016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.577023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.577029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.577034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.577038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.577042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.577046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.577051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.577056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.577061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.577066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.577072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.577082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.577087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.577095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.577100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.577104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.577113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.577117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.577121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.577125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.577133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.577138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.577142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.577150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.577154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.577158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.577167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.577202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:52.585080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:52.585856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:52.585874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:52.585877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:52.585880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:52.585889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2368 [2:7556256619774430123:8783]
2025-10-01T14:14:52.585906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:52.585931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:52.585938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.585943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.585946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.585964Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:52.585974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:52.585981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:52.586055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.586063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.586066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.586069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:52.586072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:52.586145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:52.586152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.586165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.586181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.586201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:52.586222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.586229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.586231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.586249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:52.586268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337629:5860], now have 1 active actors on pipe
2025-10-01T14:14:52.586269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:52.586273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:52.586275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:52.586276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337338:2446], now have 1 active actors on pipe
2025-10-01T14:14:52.586285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:52.586298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:52.586301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:52.586354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2368
2025-10-01T14:14:52.586345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.586412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2368
2025-10-01T14:14:52.586357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:52.586399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:52.586597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.586607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.586640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:52.586648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.586652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.586655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:52.586665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.586676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:52.586694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.586876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.586888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.586910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.587046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2369 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0
2025-10-01T14:14:52.587491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea41969-6ef4a1b0-45c30423-d3872887_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:52.590540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Write session: try to update token
2025-10-01T14:14:52.590560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:52.606994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:52.607012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:52.607015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:52.607017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:52.607067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.607072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.607076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256619774430118:8783]
2025-10-01T14:14:52.607132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:52.607139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.607137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:52.607142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:52.607144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:52.607148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:52.607305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:52.618486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId: src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:52.621822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:52.651069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256622151337670:7265]
2025-10-01T14:14:52.651723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2368, pipe: [1:7556256622151337670:7265]
2025-10-01T14:14:52.773724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:52.774112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.774127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.774149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337670:7265], now have 1 active actors on pipe
2025-10-01T14:14:52.774412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:52.774415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:52.774434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:52.774498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2369 reason: error at write: Disconnected sessionId: src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0
2025-10-01T14:14:52.774748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2369 sessionId: src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0 is DEAD
2025-10-01T14:14:52.774814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:52.774863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256622151337670:7265]
2025-10-01T14:14:52.778486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:52.778501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Write session will restart in 0.007414s
2025-10-01T14:14:52.778530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Write session: Do CDS request
2025-10-01T14:14:52.778537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:52.786875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.786968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:52.786988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2370
2025-10-01T14:14:52.787179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.787217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:52.787223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:52.787227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:52.787677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2370 sessionId:  describe result for acl check
2025-10-01T14:14:52.787715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:52.787717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:52.787718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:52.787724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256622151337951:5852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:52.788220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256622151337951:5852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:52.788961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:52.790073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256622151337951:5852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:52.790356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:52.790554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:52.790563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:52.790574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:52.790616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:52.790652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256619774430358:8763]
2025-10-01T14:14:52.791101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:52.791366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:52.791398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:52.791606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:52.791645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.791649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.791650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.791650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.791651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.791652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.791652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.791653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.791654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.791654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.791655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.791656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.791657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.791658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.791661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.791667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.791670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.791673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.791675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.791677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.791679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.791681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.791684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.791686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.791688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.791690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.791693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.791695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.791699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.791704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:52.791708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.791711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:52.791714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.791717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:52.791720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.791723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:52.791726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.791729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:52.791732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.791735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:52.791738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.791741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:52.791744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.791747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:52.791749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.791752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:52.791755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.791758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.791761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.791764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.791766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.791769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.791772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.791775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:52.791778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.791780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:52.791811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:52.792583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256622151337951:5852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:52.792596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256622151337951:5852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:52.792600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256622151337951:5852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:52.792606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:52.795613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:52.796414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:52.796430Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:52.796433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:52.796437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:52.796444Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2369 [2:7556256619774430358:8763]
2025-10-01T14:14:52.796458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:52.796477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:52.796484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.796487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.796494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.796510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:52.796520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:52.796530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:52.796604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.796611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.796613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.796616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:52.796619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:52.796682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:52.796690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.796701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:52.796717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:52.796737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:52.796759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337992:5852], now have 1 active actors on pipe
2025-10-01T14:14:52.796770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151337672:2446], now have 1 active actors on pipe
2025-10-01T14:14:52.796777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.796779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.796781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.796794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:52.796804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:52.796809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:52.796812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:52.796814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:52.796824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:52.796826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:52.796862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.796873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:52.796889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:52.796899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2369
2025-10-01T14:14:52.796906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2369
2025-10-01T14:14:52.796965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.796975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.797004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef11c35d-866506b-f37f74db-71deb0be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:52.797015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:52.797020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:52.797027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:52.797037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:52.797051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:52.797071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.797219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.797228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.797246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:52.797326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2370 partition: 0 MaxSeqNo: 45 sessionId: src_id|ef11c35d-866506b-f37f74db-71deb0be_0
2025-10-01T14:14:52.797724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0ce040-f9386861-1c7aad27-e9edbf6b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ef11c35d-866506b-f37f74db-71deb0be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:52.800624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Write session: try to update token
2025-10-01T14:14:52.800640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:52.821854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:52.821876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:52.821879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:52.821881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:52.821893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.821900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.821905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256619774430353:8763]
2025-10-01T14:14:52.821961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:52.821961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:52.821968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:52.821971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:52.821975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:52.821978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:52.822134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:52.826123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId: src_id|ef11c35d-866506b-f37f74db-71deb0be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:52.830395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:52.878275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256622151338000:7265]
2025-10-01T14:14:52.879790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2369, pipe: [1:7556256622151338000:7265]
2025-10-01T14:14:52.987425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:52.988094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:52.988109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:52.988150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151338000:7265], now have 1 active actors on pipe
2025-10-01T14:14:52.988627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:52.989045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:52.989059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Write session will restart in 0.006510s
2025-10-01T14:14:52.989087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Write session: Do CDS request
2025-10-01T14:14:52.989093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:52.988643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256622151338000:7265]
2025-10-01T14:14:52.988643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:52.988647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:52.988677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:52.988707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2370 reason: error at write: Disconnected sessionId: src_id|ef11c35d-866506b-f37f74db-71deb0be_0
2025-10-01T14:14:52.988890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2370 sessionId: src_id|ef11c35d-866506b-f37f74db-71deb0be_0 is DEAD
2025-10-01T14:14:52.997080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.998536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:52.998558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2371
2025-10-01T14:14:52.998762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:52.998786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:52.998790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:52.998794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:53.000229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2371 sessionId:  describe result for acl check
2025-10-01T14:14:53.000273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:53.000275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:53.000277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:53.000282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256622151338070:5834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:53.000917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256622151338070:5834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:53.004870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256622151338070:5834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:53.014905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256622151338070:5834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:53.014928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256622151338070:5834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:53.014932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256622151338070:5834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:53.014942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:53.038608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:53.042700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:53.042956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:53.042970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:53.042983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:53.043034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:53.043077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256624069397861:8753]
2025-10-01T14:14:53.043793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:53.044207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:53.044252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:53.044616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:53.044676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.044694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.044695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.044696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.044697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.044699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.044700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.044701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.044703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.044705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.044706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.044708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.044709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.044710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.044716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.044727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.044731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.044736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.044739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.044743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.044747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.044751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.044755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.044760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.044764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.044768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.044772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.044776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.044783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.044791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.044798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.044803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.044808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.044815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.044819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.044825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.044830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.044836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.044840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.044845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.044850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.044855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.044859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.044869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.044874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.044879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.044883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.044888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.044896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.044901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.044906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.044916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.044922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.044927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.044933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.044938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.044980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:53.049009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:53.050032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:53.050048Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:53.050051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:53.050055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:53.050062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2370 [2:7556256624069397861:8753]
2025-10-01T14:14:53.050080Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:53.050098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:53.050101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.050105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.050107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.050122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:53.050127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:53.050142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:53.050210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.050214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.050217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.050221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:53.050223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:53.050293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:53.050295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.050308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.050319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.050336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:53.050352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.050355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.050357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.050367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:53.050396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:53.050399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:53.050403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:53.050406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:53.050411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:53.050413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:53.050424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446305505:5834], now have 1 active actors on pipe
2025-10-01T14:14:53.050428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256622151338017:2446], now have 1 active actors on pipe
2025-10-01T14:14:53.050456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.050463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:53.050613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:53.050789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2370
2025-10-01T14:14:53.050836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2370
2025-10-01T14:14:53.051018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.051027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.051056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:53.051063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.051067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.051069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:53.051079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.051089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:53.051103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.051362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.051368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.051382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.051741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2371 partition: 0 MaxSeqNo: 45 sessionId: src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0
2025-10-01T14:14:53.052093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef11c35d-866506b-f37f74db-71deb0be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:53.055068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Write session: try to update token
2025-10-01T14:14:53.055089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:53.077006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:53.077027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.077030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:53.077032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:53.077044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.077050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.077054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256624069397855:8753]
2025-10-01T14:14:53.077110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:53.077118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.077121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:53.077129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:53.077137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:53.077141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:53.077265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:53.082432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId: src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:53.085218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:53.090444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256626446305640:7265]
2025-10-01T14:14:53.094646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2370, pipe: [1:7556256626446305640:7265]
2025-10-01T14:14:53.235072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:53.235443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.235460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.235486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446305640:7265], now have 1 active actors on pipe
2025-10-01T14:14:53.235817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:53.236598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:53.236606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Write session will restart in 0.009761s
2025-10-01T14:14:53.236624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Write session: Do CDS request
2025-10-01T14:14:53.236629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:53.235824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256626446305640:7265]
2025-10-01T14:14:53.235870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:53.235873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:53.235928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2371 reason: error at write: Disconnected sessionId: src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0
2025-10-01T14:14:53.236070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:53.236132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2371 sessionId: src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0 is DEAD
2025-10-01T14:14:53.248869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.249710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:53.249729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2372
2025-10-01T14:14:53.250275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.250306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:53.250311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:53.250315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:53.250757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2372 sessionId:  describe result for acl check
2025-10-01T14:14:53.250782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:53.250783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:53.250786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:53.250790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256626446305656:5826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:53.251319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256626446305656:5826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:53.260341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256626446305656:5826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:53.262569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256626446305656:5826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:53.262583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256626446305656:5826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:53.262587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256626446305656:5826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:53.262595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:53.278755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:53.280120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:53.280282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:53.280290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:53.280297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:53.280329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:53.280360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256624069398072:8748]
2025-10-01T14:14:53.280787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:53.281088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:53.281122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:53.281341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:53.281383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.281388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.281389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.281389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.281390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.281391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.281392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.281392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.281393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.281394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.281395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.281395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.281396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.281397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.281400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.281407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.281409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.281411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.281414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.281417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.281419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.281421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.281423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.281426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.281428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.281430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.281432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.281434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.281439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.281444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.281448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.281451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.281454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.281457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.281460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.281463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.281466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.281469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.281471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.281474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.281477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.281481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.281484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.281487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.281490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.281494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.281496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.281499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.281502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.281505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.281507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.281510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.281512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.281515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.281520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.281523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.281545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:53.285204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:53.286078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:53.286091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:53.286093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:53.286096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:53.286102Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2371 [2:7556256624069398072:8748]
2025-10-01T14:14:53.286116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:53.286130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:53.286136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.286138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.286140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.286153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:53.286161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:53.286166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:53.286212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.286217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.286219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.286222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:53.286224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:53.286280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:53.286287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.286295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.286302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.286312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:53.286325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.286330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.286331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.286341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:53.286351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:53.286363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:53.286400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:53.286434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.286441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:53.286443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:53.286445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:53.286447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:53.286452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:53.286635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446305643:2446], now have 1 active actors on pipe
2025-10-01T14:14:53.286644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446305692:5826], now have 1 active actors on pipe
2025-10-01T14:14:53.286772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2371
2025-10-01T14:14:53.286815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2371
2025-10-01T14:14:53.287088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.287101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.287128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:53.287141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.287146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.287148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:53.287160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.287170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:53.287191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.287412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.287422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.287436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.290185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2372 partition: 0 MaxSeqNo: 45 sessionId: src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0
2025-10-01T14:14:53.290575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d72545-cccc74f9-56e4fdf1-5ebc2f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:53.293479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Write session: try to update token
2025-10-01T14:14:53.293506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:53.298531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:53.298548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.298559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.298601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:53.298735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:53.298777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:53.298916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.299071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.299219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.299418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:53.299460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:53.318262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId: src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:53.321208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:53.322298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:53.322315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.322316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:53.322318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:53.322326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.322329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.322331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256624069398067:8748]
2025-10-01T14:14:53.322385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:53.322397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.322399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:53.322484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:53.322499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:53.322503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:53.322538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:53.336159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256626446305994:7265]
2025-10-01T14:14:53.336743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2371, pipe: [1:7556256626446305994:7265]
2025-10-01T14:14:53.469658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:53.469989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.470002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.470021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446305994:7265], now have 1 active actors on pipe
2025-10-01T14:14:53.470226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:53.470235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:53.470252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:53.470258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:53.470309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256626446305994:7265]
2025-10-01T14:14:53.470314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2372 reason: error at write: Disconnected sessionId: src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0
2025-10-01T14:14:53.470510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2372 sessionId: src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0 is DEAD
2025-10-01T14:14:53.470741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:53.470756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Write session will restart in 0.007060s
2025-10-01T14:14:53.470789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Write session: Do CDS request
2025-10-01T14:14:53.470796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:53.478892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.478952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:53.478970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2373
2025-10-01T14:14:53.479156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.479187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:53.479197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:53.479201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:53.479599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2373 sessionId:  describe result for acl check
2025-10-01T14:14:53.479639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:53.479645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:53.479647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:53.479652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256626446306197:5795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:53.480107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256626446306197:5795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:53.482549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256626446306197:5795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:53.482714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:53.484078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:53.484271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:53.484284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:53.484297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:53.484348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:53.484386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256624069398286:8744]
2025-10-01T14:14:53.484986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:53.485249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:53.485276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256626446306197:5795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:53.485290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:53.485291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256626446306197:5795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:53.485294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256626446306197:5795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:53.485302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:53.485574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:53.485632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.485638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.485639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.485640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.485641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.485642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.485643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.485644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.485645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.485646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.485647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.485648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.485649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.485650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.485655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.485666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.485670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.485674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.485678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.485683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.485686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.485691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.485695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.485699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.485703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.485705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.485709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.485713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.485718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.485725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.485730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.485734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.485738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.485742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.485745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.485750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.485754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.485760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.485766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.485776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.485780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.485784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.485788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.485792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.485797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.485805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.485810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.485815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.485823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.485827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.485831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.485840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.485845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.485853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.485857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.485862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.485900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:53.489627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:53.490466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:53.490479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:53.490482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:53.490486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:53.490492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2372 [2:7556256624069398286:8744]
2025-10-01T14:14:53.490506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:53.490523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:53.490526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.490529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.490531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.490548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:53.490559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:53.490566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:53.490624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.490630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.490632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.490636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:53.490638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:53.490707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:53.490714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.490726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.490741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.490761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:53.490783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306318:5795], now have 1 active actors on pipe
2025-10-01T14:14:53.490791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446305997:2446], now have 1 active actors on pipe
2025-10-01T14:14:53.490798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.490804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.490806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.490820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:53.490831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:53.490837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:53.490839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:53.490841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:53.490850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:53.490853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:53.490884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.490895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:53.490901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:53.491404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2372
2025-10-01T14:14:53.491437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2372
2025-10-01T14:14:53.491498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.491511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.491541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:53.491554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.491559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.491562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:53.491574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.491588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:53.491608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.491853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.491862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.491877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.491966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2373 partition: 0 MaxSeqNo: 45 sessionId: src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0
2025-10-01T14:14:53.492353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e943bb-3bf19f26-a5b6a794-f35f6a33_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:53.495549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Write session: try to update token
2025-10-01T14:14:53.495571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:53.504224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:53.504242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.504253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.504297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:53.504317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:53.504477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:53.504641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.504785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.504919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.505177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:53.505210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:53.513303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId: src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:53.516244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:53.516456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.516479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.516519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:53.516627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:53.522979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:53.522998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.523001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:53.523003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:53.523015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.523020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.523025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256624069398281:8744]
2025-10-01T14:14:53.523074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:53.523083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.523088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:53.523090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:53.523095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:53.523105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:53.523224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:53.570750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256626446306331:7265]
2025-10-01T14:14:53.571446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2372, pipe: [1:7556256626446306331:7265]
2025-10-01T14:14:53.675958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:53.685049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.685090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.685287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.685361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.685433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.685506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.685553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.685558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.685632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.685698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.685770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.685851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.685901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.685905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.685990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.686063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.686134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.686207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.686256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.686260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.686345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.686504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.686578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.686648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.686693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.686696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.686772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.686839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.686910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.686985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.687051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.687054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.687131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.687194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.687262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.687325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.687370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.687373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.687447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.687506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.687577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.687641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.687686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.687689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.687758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.687816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.687879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.687936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.687980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.687983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.688076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.688161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.688252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.688339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.688412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.688416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.688501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.688586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.688670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.688749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.688800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.688803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.689562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306331:7265], now have 1 active actors on pipe
2025-10-01T14:14:53.690527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:53.690542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256626446306331:7265]
2025-10-01T14:14:53.690547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:53.690571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:53.690578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2373 reason: error at write: Disconnected sessionId: src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0
2025-10-01T14:14:53.690772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2373 sessionId: src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0 is DEAD
2025-10-01T14:14:53.690892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:53.693481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:53.693497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Write session will restart in 0.005374s
2025-10-01T14:14:53.693523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Write session: Do CDS request
2025-10-01T14:14:53.693529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:53.701021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.701094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:53.701112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2374
2025-10-01T14:14:53.701301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.701336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:53.701346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:53.701349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:53.701806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2374 sessionId:  describe result for acl check
2025-10-01T14:14:53.701847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:53.701853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:53.701855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:53.701860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256626446306494:5789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:53.702409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256626446306494:5789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:53.705100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256626446306494:5789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:53.708111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256626446306494:5789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:53.708127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256626446306494:5789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:53.708130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256626446306494:5789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:53.708139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:53.710458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:53.710991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:53.711203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:53.711219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:53.711234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:53.711301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:53.711341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256624069398537:8733]
2025-10-01T14:14:53.711943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:53.712296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:53.712350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:53.712728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:53.712799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.712804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.712805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.712806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.712808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.712808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.712810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.712811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.712812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.712813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.712814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.712815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.712816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.712817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.712823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.712834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.712837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.712841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.712845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.712850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.712854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.712857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.712861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.712865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.712868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.712872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.712876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.712884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.712891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.712903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.712913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.712923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.712931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.712936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.712944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.712950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.712954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.712959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.712963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.712968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.712977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.713001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.713005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.713015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.713024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.713030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.713034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.713044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.713052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.713057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.713065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.713070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.713079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.713084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.713092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.713098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.713158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:53.718823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:53.720110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:53.720125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:53.720127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:53.720131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:53.720139Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2373 [2:7556256624069398537:8733]
2025-10-01T14:14:53.720155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:53.720173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:53.720176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.720179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.720181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.720198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:53.720204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:53.720216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:53.720277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.720283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.720285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.720289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:53.720292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:53.720363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:53.720369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.720382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.720393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.720413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:53.720431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306339:2446], now have 1 active actors on pipe
2025-10-01T14:14:53.720438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306657:5789], now have 1 active actors on pipe
2025-10-01T14:14:53.720446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.720452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.720454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.720468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:53.720479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:53.720485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:53.720488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:53.720491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:53.720500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:53.720503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:53.720541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.720564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:53.720582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:53.720562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2373
2025-10-01T14:14:53.720615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2373
2025-10-01T14:14:53.721041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.721066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.721098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:53.721109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.721113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.721115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:53.721126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.721146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:53.721170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.721344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.721349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.721360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.721433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2374 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0
2025-10-01T14:14:53.721852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfc7db9-27400379-e5447a68-4cf3ac00_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:53.725086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Write session: try to update token
2025-10-01T14:14:53.725109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:53.735313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:53.735332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.735344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.735381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:53.735391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:53.735587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:53.735751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.735933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.736091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:53.736298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:53.736344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:53.743702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId: src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:53.746441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:53.746723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.746761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.746801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:53.747046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:53.756727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:53.756744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:53.756747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:53.756749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:53.756760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.756764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.756767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256624069398531:8733]
2025-10-01T14:14:53.756816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:53.756823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.756827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:53.756964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:53.758504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:53.758519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:53.758522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:53.794510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256626446306670:7265]
2025-10-01T14:14:53.795363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2373, pipe: [1:7556256626446306670:7265]
2025-10-01T14:14:53.907520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:53.918928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.918960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.919153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.919219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.919295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.919361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.919408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.919413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.919489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.919555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.919617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.919709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.919757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.919764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.919849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.919912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.919981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.920054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.920518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.920533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.920911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.920988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.921058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.921129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.921171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.921175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.921254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.921319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.921389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.921460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.921510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.921515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.921594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.921712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.921780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.921853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.921967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.921971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.922049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.922110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.922180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.922256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.922301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.922304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.922405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.922472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.922541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.922609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.922655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.922659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.922737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.922804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.922876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.922947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.922997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.923000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.923079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:53.923144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:53.923213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:53.923282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:53.923327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:53.923330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:53.923420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306670:7265], now have 1 active actors on pipe
2025-10-01T14:14:53.925255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:53.926496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:53.926512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Write session will restart in 0.006515s
2025-10-01T14:14:53.926542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Write session: Do CDS request
2025-10-01T14:14:53.926548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:53.925767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256626446306670:7265]
2025-10-01T14:14:53.925807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:53.925832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:53.925862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0
2025-10-01T14:14:53.926077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2374 sessionId: src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0 is DEAD
2025-10-01T14:14:53.934880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.935256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:53.935280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2375
2025-10-01T14:14:53.935460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:53.935491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:53.935497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:53.935502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:53.935938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2375 sessionId:  describe result for acl check
2025-10-01T14:14:53.935971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:53.935972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:53.935974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:53.935981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256626446306685:5767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:53.936586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256626446306685:5767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:53.940252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256626446306685:5767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:53.946331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256626446306685:5767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:53.946351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256626446306685:5767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:53.946354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256626446306685:5767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:53.946362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:53.963322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:53.966058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:53.966265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:53.966270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:53.966279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:53.966322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:53.966363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256624069398751:8716]
2025-10-01T14:14:53.967251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:53.970545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:53.970616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:53.971009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:53.971070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.971071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.971073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.971075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.971077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.971079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.971080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.971082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.971083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.971085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.971086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.971088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.971090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.971097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.971108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.971112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.971116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.971120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.971124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.971128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.971131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.971136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.971143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.971147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.971151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.971155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.971159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.971168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.971179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:53.971186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.971192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:53.971196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.971201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:53.971208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.971213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:53.971218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.971223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:53.971227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.971232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:53.971240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.971246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:53.971250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.971255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:53.971260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.971265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:53.971269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.971275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.971280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.971285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.971289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.971294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.971299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.971304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:53.971309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.971316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:53.971360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:53.985343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:53.986051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:53.986070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:53.986075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:53.986080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:53.986090Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2374 [2:7556256624069398751:8716]
2025-10-01T14:14:53.986111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:53.986131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:53.986135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.986139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.986142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.986160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:53.986166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:53.986175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:53.986256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.986259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.986262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.986266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:53.986269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:53.986353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:53.986356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:53.986411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:53.986423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:53.986440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:53.986463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:53.986466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:53.986469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:53.986487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:53.986507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:53.986516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:53.986522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:53.986525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:53.986525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:53.986529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:53.986574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:53.986583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:53.986629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:53.986674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306803:5767], now have 1 active actors on pipe
2025-10-01T14:14:53.986684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256626446306673:2446], now have 1 active actors on pipe
2025-10-01T14:14:53.987422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.987436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.987472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:53.987484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:53.987489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:53.987492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:53.987503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:53.987520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:53.987538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.987726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:53.987734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:53.987750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:53.988339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3bdc4a-214e3c68-aedea525-45c482e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:53.986877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2374
2025-10-01T14:14:53.986899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2374
2025-10-01T14:14:53.987987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2375 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0
2025-10-01T14:14:53.991530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Write session: try to update token
2025-10-01T14:14:53.991549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:54.012264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:54.012288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.012291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:54.012294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:54.012305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:54.012315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:54.012320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256624069398745:8716]
2025-10-01T14:14:54.012376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:54.012385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.012392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:54.012586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:54.012992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId: src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:54.014431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:54.014448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:54.014454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:54.016430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:54.025793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256630741274316:7265]
2025-10-01T14:14:54.026227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2374, pipe: [1:7556256630741274316:7265]
2025-10-01T14:14:54.154747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:54.155642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.155664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.155710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741274316:7265], now have 1 active actors on pipe
2025-10-01T14:14:54.155964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:54.155960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:54.155983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:54.156033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256630741274316:7265]
2025-10-01T14:14:54.156037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2375 reason: error at write: Disconnected sessionId: src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0
2025-10-01T14:14:54.156072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:54.156228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2375 sessionId: src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0 is DEAD
2025-10-01T14:14:54.156436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:54.156446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Write session will restart in 0.008961s
2025-10-01T14:14:54.156476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Write session: Do CDS request
2025-10-01T14:14:54.156481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:54.166854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.166881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:54.166903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2376
2025-10-01T14:14:54.167071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.167106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:54.167117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:54.167122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:54.167573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2376 sessionId:  describe result for acl check
2025-10-01T14:14:54.167618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:54.167699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:54.167703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:54.167709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256630741274479:5754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:54.168306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256630741274479:5754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:54.170812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256630741274479:5754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:54.173186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:54.175316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:54.175519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:54.175530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:54.175540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:54.175593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:54.175643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256628364366257:8709]
2025-10-01T14:14:54.175688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256630741274479:5754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:54.175712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256630741274479:5754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:54.175715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256630741274479:5754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:54.175723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:54.176226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:54.176516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:54.176571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:54.176875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:54.176928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.176934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.176935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.176936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.176937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.176939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.176940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.176942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.176943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.176944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.176945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.176947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.176948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.176949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.176954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.176963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.176967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.176972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.176975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.176978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.176982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.176985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.176989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.176992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.176995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.176999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.177002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.177006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.177012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.177019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.177024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.177029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.177034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.177039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.177043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.177047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.177052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.177056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.177061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.177065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.177070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.177074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.177078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.177082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.177087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.177092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.177096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.177100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.177104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.177109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.177112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.177119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.177123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.177127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.177131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.177136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.177169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:54.182272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2375
2025-10-01T14:14:54.182328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2375
2025-10-01T14:14:54.181151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:54.181901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:54.181906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:54.181909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:54.181913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:54.181920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2375 [2:7556256628364366257:8709]
2025-10-01T14:14:54.181938Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:54.181955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:54.181958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.181962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.181964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.181980Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:54.181985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:54.181992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:54.182048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.182050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.182052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.182056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:54.182058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:54.182129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:54.182132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.182142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.182151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.182174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:54.182193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741274319:2446], now have 1 active actors on pipe
2025-10-01T14:14:54.182198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741274641:5754], now have 1 active actors on pipe
2025-10-01T14:14:54.182205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.182207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.182209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.182227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:54.182240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:54.182253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:54.182255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:54.182272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:54.182277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:54.182281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:54.182282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.182285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:54.182289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:54.182520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.182532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.182576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:54.182588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.182595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.182599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:54.182613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.182630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:54.182653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.183434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.183452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.183476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.183585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2376 partition: 0 MaxSeqNo: 45 sessionId: src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0
2025-10-01T14:14:54.183964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a729ead-b5bf9f8e-91557949-89ac8fde_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:54.187637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Write session: try to update token
2025-10-01T14:14:54.187654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:54.196075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:54.196093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.196104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.196155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:54.196173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:54.196348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:54.196495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:54.196649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:54.196794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:54.196988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:54.197028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:54.213538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId: src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:54.216677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:54.216911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.216934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.216968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:54.217079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:54.220930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:54.220955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.220957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:54.220959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:54.220970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.220973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.220978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256628364366252:8709]
2025-10-01T14:14:54.221030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:54.221033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:54.221039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:54.221040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.221043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:54.221044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:54.221194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:54.256199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256630741274652:7265]
2025-10-01T14:14:54.256540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2375, pipe: [1:7556256630741274652:7265]
2025-10-01T14:14:54.365182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:54.374334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.374359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.374553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.374630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.374717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.374804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.374861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.374871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.374948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.375019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.375096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.375185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.375259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.375268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.375351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.375429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.375510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.375592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.375654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.375662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.375744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.375828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.375907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.375989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.376043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.376051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.376133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.376209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.376284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.376356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.376411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.376419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.376497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.376580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.376655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.376727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.376776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.376783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.376853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.376909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.376971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.377032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.377074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.377079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.377140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.377194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.377250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.377312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.377364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.377370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.377431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.377487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.377545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.377597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.377636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.377641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.377695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.377747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.377803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.377871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.377916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.377921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.377977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741274652:7265], now have 1 active actors on pipe
2025-10-01T14:14:54.378192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:54.378244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256630741274652:7265]
2025-10-01T14:14:54.378243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:54.378248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:54.378279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2376 reason: error at write: Disconnected sessionId: src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0
2025-10-01T14:14:54.378556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2376 sessionId: src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0 is DEAD
2025-10-01T14:14:54.378665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:54.378678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Write session will restart in 0.006891s
2025-10-01T14:14:54.378704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Write session: Do CDS request
2025-10-01T14:14:54.378711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:54.379048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:54.386793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.387119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:54.387136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2377
2025-10-01T14:14:54.387342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.387398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:54.387419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:54.387430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:54.387782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2377 sessionId:  describe result for acl check
2025-10-01T14:14:54.387812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:54.387814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:54.387816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:54.387821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256630741274766:5722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:54.388319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256630741274766:5722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:54.390350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256630741274766:5722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:54.393579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256630741274766:5722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:54.393593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256630741274766:5722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:54.393595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256630741274766:5722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:54.393600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:54.395304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:54.397057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:54.397212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:54.397223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:54.397233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:54.397280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:54.397320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256628364366479:8711]
2025-10-01T14:14:54.397798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:54.398076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:54.398105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:54.398323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:54.398366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.398391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.398392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.398394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.398395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.398397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.398398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.398399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.398399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.398400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.398401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.398401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.398402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.398402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.398406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.398412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.398414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.398416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.398418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.398420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.398422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.398424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.398426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.398428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.398430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.398431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.398433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.398435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.398440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.398447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.398450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.398454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.398456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.398460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.398462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.398465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.398468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.398471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.398473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.398476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.398479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.398482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.398484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.398488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.398490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.398493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.398495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.398498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.398500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.398503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.398505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.398508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.398511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.398513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.398518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.398521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.398541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:54.402292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:54.402970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:54.402983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:54.402985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:54.402989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:54.402996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2376 [2:7556256628364366479:8711]
2025-10-01T14:14:54.403012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:54.403029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:54.403031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.403035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.403038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.403055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:54.403066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:54.403077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:54.403137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.403144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.403146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.403149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:54.403152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:54.403222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:54.403229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.403241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.403256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.403276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:54.403298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741274996:5722], now have 1 active actors on pipe
2025-10-01T14:14:54.403306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741274680:2446], now have 1 active actors on pipe
2025-10-01T14:14:54.403312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.403317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.403320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.403332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:54.403346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:54.403349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:54.403355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:54.403358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:54.403362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:54.403365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:54.403394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.403405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:54.403393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2376
2025-10-01T14:14:54.403441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:54.403395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2376
2025-10-01T14:14:54.403484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.403493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.403520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|952cfff1-90098aea-ef06d802-6c61310c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:54.403529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.403538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.403540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:54.403551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.403564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:54.403580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.403776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.403788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.403810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.403932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2377 partition: 0 MaxSeqNo: 45 sessionId: src_id|952cfff1-90098aea-ef06d802-6c61310c_0
2025-10-01T14:14:54.404255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c626da55-9f1ce7dd-d690296b-294a0fc1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|952cfff1-90098aea-ef06d802-6c61310c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:54.407547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Write session: try to update token
2025-10-01T14:14:54.407565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:54.415090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:54.415106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.415115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.415155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:54.415159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:54.415310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:54.415438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:54.415580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:54.415713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:54.415914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:54.415951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:54.425317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId: src_id|952cfff1-90098aea-ef06d802-6c61310c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:54.428133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:54.428379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.428401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.428434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:54.428538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:54.434611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:54.434632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.434635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:54.434638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:54.434650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.434655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.434659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256628364366474:8711]
2025-10-01T14:14:54.434713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:54.434719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:54.434719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:54.434722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:54.434727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.434730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:54.434878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:54.478435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256630741275012:7265]
2025-10-01T14:14:54.478704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2376, pipe: [1:7556256630741275012:7265]
2025-10-01T14:14:54.581721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:54.591576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.591612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.591799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.591873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.591949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.592018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.592077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.592086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.592159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.592231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.592296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.592381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.592433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.592436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.592514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.592593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.592657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.592718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.592758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.592760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.592823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.592878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.592931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.592991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.593043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.593046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.593126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.593189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.593245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.593306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.593348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.593351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.593413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.593466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.593524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.593579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.593618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.593621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.593682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.593734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.593789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.593845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.593883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.593885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.593943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.593991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.594049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.594115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.594156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.594159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.594232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.594288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.594342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.594438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.594484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.594487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.594554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:54.594611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:54.594674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:54.594748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:54.594800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:54.594809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:54.594875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275012:7265], now have 1 active actors on pipe
2025-10-01T14:14:54.595341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:54.595354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:54.595358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:54.595388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2377 reason: error at write: Disconnected sessionId: src_id|952cfff1-90098aea-ef06d802-6c61310c_0
2025-10-01T14:14:54.595413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256630741275012:7265]
2025-10-01T14:14:54.595614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2377 sessionId: src_id|952cfff1-90098aea-ef06d802-6c61310c_0 is DEAD
2025-10-01T14:14:54.595741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:54.595752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Write session will restart in 0.009023s
2025-10-01T14:14:54.595780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Write session: Do CDS request
2025-10-01T14:14:54.595786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:54.596233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:54.605896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.606519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:54.606540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2378
2025-10-01T14:14:54.606699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.606731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:54.606736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:54.606740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:54.607226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2378 sessionId:  describe result for acl check
2025-10-01T14:14:54.607273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:54.607277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:54.607279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:54.607285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256630741275093:5697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:54.607851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256630741275093:5697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:54.611023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256630741275093:5697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:54.615085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256630741275093:5697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:54.615106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256630741275093:5697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:54.615109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256630741275093:5697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:54.615119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:54.634168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:54.636994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:54.637299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:54.637320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:54.637332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:54.637399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:54.637445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256628364366706:8703]
2025-10-01T14:14:54.638071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:54.638471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:54.638520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:54.638820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:54.638896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.638904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.638905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.638906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.638908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.638909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.638911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.638912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.638914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.638915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.638917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.638918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.638920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.638921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.638927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.638939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.638943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.638948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.638952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.638957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.638960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.638964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.638968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.638972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.638976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.638980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.638984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.638988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.638995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.639004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.639012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.639017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.639023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.639029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.639034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.639039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.639044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.639050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.639055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.639060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.639066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.639071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.639076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.639081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.639086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.639092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.639097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.639102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.639111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.639117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.639126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.639131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.639136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.639141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.639146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.639151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.639189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:54.644837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:54.645598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:54.645618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:54.645619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:54.645622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:54.645638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2377 [2:7556256628364366706:8703]
2025-10-01T14:14:54.645654Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:54.645670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:54.645672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.645675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.645677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.645690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:54.645694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:54.645699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:54.645747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.645749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.645750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.645752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:54.645754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:54.645827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:54.645838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.645846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.645852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.645863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:54.645876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.645878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.645879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.645886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:54.645897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:54.645900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275021:2446], now have 1 active actors on pipe
2025-10-01T14:14:54.645903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275204:5697], now have 1 active actors on pipe
2025-10-01T14:14:54.645906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:54.645908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:54.645910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:54.645919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:54.645922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:54.645960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.645975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:54.646005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2377
2025-10-01T14:14:54.646065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2377
2025-10-01T14:14:54.645984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:54.646252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.646268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.646301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:54.646309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.646314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.646317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:54.646329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.646341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:54.646367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.646670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.646680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.646694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.646820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2378 partition: 0 MaxSeqNo: 45 sessionId: src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0
2025-10-01T14:14:54.647193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|952cfff1-90098aea-ef06d802-6c61310c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:54.650038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Write session: try to update token
2025-10-01T14:14:54.650057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:54.679063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId: src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:54.679139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:54.679157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.679159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:54.679161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:54.679170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.679177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.679181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256628364366701:8703]
2025-10-01T14:14:54.679221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:54.679223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:54.679228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.679230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:54.679234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:54.679238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:54.679362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:54.681969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:54.695484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256630741275360:7265]
2025-10-01T14:14:54.695767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2377, pipe: [1:7556256630741275360:7265]
2025-10-01T14:14:54.819999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:54.820480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.820492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.820528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275360:7265], now have 1 active actors on pipe
2025-10-01T14:14:54.820711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:54.820814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:54.820843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256630741275360:7265]
2025-10-01T14:14:54.820879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:54.820980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2378 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0
2025-10-01T14:14:54.821178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2378 sessionId: src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0 is DEAD
2025-10-01T14:14:54.821323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:54.821334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Write session will restart in 0.009566s
2025-10-01T14:14:54.821364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Write session: Do CDS request
2025-10-01T14:14:54.821370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:54.831869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.831972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:54.831994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2379
2025-10-01T14:14:54.832129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:54.832171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:54.832180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:54.832185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:54.832721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2379 sessionId:  describe result for acl check
2025-10-01T14:14:54.832761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:54.832768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:54.832770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:54.832776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256630741275653:5687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:54.833376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256630741275653:5687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:54.834061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:54.835585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256630741275653:5687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:54.835791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:54.835989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:54.835998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:54.836020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:54.836066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:54.836106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256628364366950:8688]
2025-10-01T14:14:54.836723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:54.837059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:54.837099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:54.837345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:54.837383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.837387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.837387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.837388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.837389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.837390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.837392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.837393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.837395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.837396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.837399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.837405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.837407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.837409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.837411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.837414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.837416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.837418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.837420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.837422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.837424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.837427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.837429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.837431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.837436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.837441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:54.837444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.837447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:54.837450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.837453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:54.837455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.837458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:54.837461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.837464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:54.837467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.837470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:54.837472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.837475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:54.837478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.837481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:54.837483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.837486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:54.837489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.837492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.837495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.837498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.837500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.837503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.837505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.837508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:54.837511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.837517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:54.837538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:54.838120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256630741275653:5687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:54.838133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256630741275653:5687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:54.838136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256630741275653:5687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:54.838143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:54.841543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:54.842279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:54.842290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:54.842292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:54.842294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:54.842300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2378 [2:7556256628364366950:8688]
2025-10-01T14:14:54.842312Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:54.842325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:54.842327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.842329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.842330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.842342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:54.842345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:54.842349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:54.842414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.842419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.842421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.842423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:54.842425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:54.842476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:54.842482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.842489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:54.842496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:54.842508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:54.842524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275691:5687], now have 1 active actors on pipe
2025-10-01T14:14:54.842533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.842538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.842539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.842546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:54.842552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:54.842555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:54.842557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:54.842559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:54.842567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:54.842572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:54.842576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275365:2446], now have 1 active actors on pipe
2025-10-01T14:14:54.842600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.842609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:54.842627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:54.842599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2378
2025-10-01T14:14:54.842640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.842612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2378
2025-10-01T14:14:54.842648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.842672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:54.842681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:54.842687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:54.842689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:54.842695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:54.842704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:54.842722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.842888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:54.842894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:54.842903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:54.842972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2379 partition: 0 MaxSeqNo: 45 sessionId: src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0
2025-10-01T14:14:54.843286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40c1da2-2d6082c1-a60025bf-da133e33_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:54.845878Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:14:54.846180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Write session: try to update token
2025-10-01T14:14:54.846195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:54.862639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId: src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:54.864654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:54.864667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:54.864669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:54.864671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:54.864679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.864682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.864685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256628364366945:8688]
2025-10-01T14:14:54.864727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:54.864735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:54.864737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:54.864738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:54.864751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:54.864755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:54.864868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:54.865526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:54.921256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256630741275699:7265]
2025-10-01T14:14:54.921484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2378, pipe: [1:7556256630741275699:7265]
2025-10-01T14:14:55.003980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:55.004591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.004608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.004654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256630741275699:7265], now have 1 active actors on pipe
2025-10-01T14:14:55.004918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:55.005952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:55.005967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Write session will restart in 0.008110s
2025-10-01T14:14:55.005992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Write session: Do CDS request
2025-10-01T14:14:55.005999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:55.005552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:55.005553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:55.005611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256630741275699:7265]
2025-10-01T14:14:55.005644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2379 reason: status is not ok: tablet will be restarted right now sessionId: src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0
2025-10-01T14:14:55.005807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2379 sessionId: src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0 is DEAD
2025-10-01T14:14:55.014857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.014962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:55.014987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2380
2025-10-01T14:14:55.015081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.015111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:55.015117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:55.015121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:55.015660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2380 sessionId:  describe result for acl check
2025-10-01T14:14:55.015696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:55.015697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:55.015699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:55.015706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256635036243085:5673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:55.016347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256635036243085:5673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:55.019070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256635036243085:5673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:55.022037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256635036243085:5673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:55.022055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256635036243085:5673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:55.022059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256635036243085:5673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:55.022067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:55.032257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:55.035337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:55.035580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:55.035592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:55.035604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:55.035657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:55.035704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256632659334462:8678]
2025-10-01T14:14:55.036479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:55.036894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:55.036947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:55.037234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:55.037286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.037287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.037288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.037289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.037290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.037291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.037292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.037293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.037294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.037295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.037296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.037297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.037299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.037300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.037303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.037312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.037316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.037320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.037323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.037327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.037330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.037334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.037338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.037342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.037346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.037350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.037354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.037358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.037365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.037372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.037379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.037384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.037388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.037393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.037398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.037404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.037410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.037416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.037419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.037425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.037429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.037435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.037439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.037444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.037449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.037454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.037458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.037464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.037469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.037473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.037478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.037483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.037488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.037493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.037498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.037502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.037544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:55.041758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:55.042885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:55.042901Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:55.042905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:55.042909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:55.042917Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2379 [2:7556256632659334462:8678]
2025-10-01T14:14:55.042934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:55.042951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:55.042954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.042958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.042960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.042977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:55.042983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:55.042991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:55.043062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.043065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.043066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.043070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:55.043072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:55.043163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:55.043167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.043181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.043191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.043208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:55.043225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.043228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.043230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.043246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:55.043263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:55.043277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:55.043280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:55.043314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.043317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:55.043930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:55.043935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:55.043938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:55.043945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:55.044323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2379
2025-10-01T14:14:55.044376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2379
2025-10-01T14:14:55.044575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243014:2446], now have 1 active actors on pipe
2025-10-01T14:14:55.044584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243280:5673], now have 1 active actors on pipe
2025-10-01T14:14:55.044600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.044606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.044633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:55.044644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.044648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.044651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:55.044663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.044678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:55.044693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.045043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.045051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.045066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.045273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2380 partition: 0 MaxSeqNo: 45 sessionId: src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0
2025-10-01T14:14:55.045630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|439d95dc-94a39f1a-763a5b7-a2274df0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:55.048743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Write session: try to update token
2025-10-01T14:14:55.048764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:55.068711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:55.068733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:55.068736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:55.068739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:55.068750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.068756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.068761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256632659334456:8678]
2025-10-01T14:14:55.068813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:55.068816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:55.068824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.068828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:55.068830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:55.068834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:55.069010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:55.077145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId: src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:55.081588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:55.108303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256635036243348:7265]
2025-10-01T14:14:55.110038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2379, pipe: [1:7556256635036243348:7265]
2025-10-01T14:14:55.225086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:55.225426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.225444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.225484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243348:7265], now have 1 active actors on pipe
2025-10-01T14:14:55.225732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:55.225752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:55.225805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2380 reason: error at write: Disconnected sessionId: src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0
2025-10-01T14:14:55.226002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:55.226138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:55.226146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Write session will restart in 0.007386s
2025-10-01T14:14:55.226170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Write session: Do CDS request
2025-10-01T14:14:55.226176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:55.225966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:55.226015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2380 sessionId: src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0 is DEAD
2025-10-01T14:14:55.226048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256635036243348:7265]
2025-10-01T14:14:55.235549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.235647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:55.235673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2381
2025-10-01T14:14:55.235843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.235889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:55.235901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:55.235906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:55.236355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2381 sessionId:  describe result for acl check
2025-10-01T14:14:55.236417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:55.236424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:55.236425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:55.236430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256635036243504:5658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:55.237022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256635036243504:5658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:55.239430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256635036243504:5658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:55.251664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256635036243504:5658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:55.251692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256635036243504:5658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:55.251696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256635036243504:5658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:55.251707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:55.270407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:55.272696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:55.273105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:55.273111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:55.273128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:55.273208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:55.273256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256632659334683:8680]
2025-10-01T14:14:55.273908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:55.275260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:55.275328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:55.275746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:55.275839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.275849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.275850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.275852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.275853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.275855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.275857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.275858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.275860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.275861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.275863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.275865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.275866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.275867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.275874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.275886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.275891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.275895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.275898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.275902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.275905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.275909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.275913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.275917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.275922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.275925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.276055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.276069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.276079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.276093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.276100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.276124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.276136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.276142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.276148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.276160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.276167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.276172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.276181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.276186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.276193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.276205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.276209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.276215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.276222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.276233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.276239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.276245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.276251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.276256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.276261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.276272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.276278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.276284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.276296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.276301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.276344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:55.286783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:55.287970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:55.287978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:55.287983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:55.287988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:55.287995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2380 [2:7556256632659334683:8680]
2025-10-01T14:14:55.288018Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:55.288040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:55.288044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.288047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.288050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.288068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:55.288074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:55.288082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:55.288158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.288161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.288164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.288168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:55.288171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:55.288259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:55.288262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.288278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.288291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.288308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:55.288328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.288331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.288336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.288360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:55.288376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:55.288390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:55.288393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:55.288442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.288445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:55.288445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:55.288451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:55.288453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:55.288462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:55.289059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2380
2025-10-01T14:14:55.289107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2380
2025-10-01T14:14:55.289085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243584:5658], now have 1 active actors on pipe
2025-10-01T14:14:55.289099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243355:2446], now have 1 active actors on pipe
2025-10-01T14:14:55.289254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.289263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.289296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:55.289305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.289310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.289313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:55.289326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.289338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:55.289354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.292150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2381 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0
2025-10-01T14:14:55.291953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.291971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.292001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.296779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d2d3f3-15a1f711-8afbefb9-b905590_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:55.300535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Write session: try to update token
2025-10-01T14:14:55.300574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:55.312119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:55.312140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:55.312143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:55.312145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:55.312157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.312162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.312166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256632659334677:8680]
2025-10-01T14:14:55.312219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:55.312226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.312228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:55.312232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:55.312240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:55.312244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:55.312367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:55.324735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId: src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:55.326988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256635036243694:7265]
2025-10-01T14:14:55.327423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2380, pipe: [1:7556256635036243694:7265]
2025-10-01T14:14:55.327632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:55.485638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:55.486215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243694:7265], now have 1 active actors on pipe
2025-10-01T14:14:55.486244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.486251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.486809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256635036243694:7265]
2025-10-01T14:14:55.486849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:55.486524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:55.486919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2381 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0
2025-10-01T14:14:55.487093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2381 sessionId: src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0 is DEAD
2025-10-01T14:14:55.487189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:55.487973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:55.487987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Write session will restart in 0.007297s
2025-10-01T14:14:55.488015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Write session: Do CDS request
2025-10-01T14:14:55.488021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:55.496948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.497335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:55.497357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2382
2025-10-01T14:14:55.497918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.497957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:55.497963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:55.497973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:55.498473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2382 sessionId:  describe result for acl check
2025-10-01T14:14:55.498512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:55.498513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:55.498515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:55.498520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256635036243755:5620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:55.499049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256635036243755:5620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:55.502302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256635036243755:5620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:55.508680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256635036243755:5620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:55.508702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256635036243755:5620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:55.508706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256635036243755:5620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:55.508715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:55.525443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:55.526591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:55.526785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:55.526795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:55.526807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:55.526861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:55.526898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256632659334907:8668]
2025-10-01T14:14:55.527495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:55.528088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:55.528135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:55.528464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:55.528528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.528536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.528537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.528538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.528539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.528540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.528542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.528543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.528544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.528546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.528547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.528548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.528561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.528562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.528568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.528577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.528581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.528584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.528588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.528591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.528594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.528598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.528601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.528605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.528609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.528612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.528616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.528619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.528626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.528634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.528641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.528646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.528649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.528654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.528658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.528663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.528667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.528671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.528675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.528680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.528685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.528690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.528694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.528698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.528702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.528707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.528711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.528721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.528726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.528734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.528737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.528742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.528749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.528754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.528757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.528766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.528801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:55.533124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:55.533839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:55.533856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:55.533859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:55.533863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:55.533872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2381 [2:7556256632659334907:8668]
2025-10-01T14:14:55.533889Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:55.533905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:55.533908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.533912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.533915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.533932Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:55.533943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:55.533949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:55.534009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.534016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.534018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.534022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:55.534024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:55.534094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:55.534105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.534116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.534125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.534138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:55.534157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243822:5620], now have 1 active actors on pipe
2025-10-01T14:14:55.534160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036243722:2446], now have 1 active actors on pipe
2025-10-01T14:14:55.534167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.534169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.534171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.534184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:55.534197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:55.534197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:55.534199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:55.534201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:55.534212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:55.534232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:55.534239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2381
2025-10-01T14:14:55.534271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.534240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2381
2025-10-01T14:14:55.534279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:55.534282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:55.534310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.534319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.534348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:55.534359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.534363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.534365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:55.534391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.534400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:55.534418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.534546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.534553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.534566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.534653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2382 partition: 0 MaxSeqNo: 45 sessionId: src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0
2025-10-01T14:14:55.534978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b1ee19-a1ab9cf4-520862db-cba07a95_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:55.537970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Write session: try to update token
2025-10-01T14:14:55.537986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:55.554923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:55.554941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:55.554944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:55.554945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:55.554953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.554956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.554960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256632659334902:8668]
2025-10-01T14:14:55.554998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:55.555003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.555005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:55.555012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:55.555028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:55.555037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:55.555145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:55.556897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId: src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:55.559373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:55.586847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256635036244063:7265]
2025-10-01T14:14:55.587073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2381, pipe: [1:7556256635036244063:7265]
2025-10-01T14:14:55.705900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:55.706171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.706187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.706225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036244063:7265], now have 1 active actors on pipe
2025-10-01T14:14:55.706464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:55.706540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:55.706557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:55.706563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:55.706603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256635036244063:7265]
2025-10-01T14:14:55.706656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2382 reason: error at write: Disconnected sessionId: src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0
2025-10-01T14:14:55.707053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:55.707062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Write session will restart in 0.007308s
2025-10-01T14:14:55.707088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Write session: Do CDS request
2025-10-01T14:14:55.707097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:55.706881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2382 sessionId: src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0 is DEAD
2025-10-01T14:14:55.715892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.716026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:55.716048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2383
2025-10-01T14:14:55.716198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.716227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:55.716234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:55.716238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:55.716767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2383 sessionId:  describe result for acl check
2025-10-01T14:14:55.716805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:55.716812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:55.716814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:55.716819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256635036244170:5601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:55.717399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256635036244170:5601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:55.720178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256635036244170:5601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:55.725602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256635036244170:5601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:55.725631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256635036244170:5601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:55.725635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256635036244170:5601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:55.725646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:55.730397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:55.735092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:55.735348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:55.735360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:55.735373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:55.735447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:55.735493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256632659335137:8666]
2025-10-01T14:14:55.736147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:55.736543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:55.736608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:55.736964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:55.737034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.737043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.737045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.737046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.737047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.737049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.737051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.737052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.737054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.737055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.737057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.737058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.737060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.737062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.737067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.737078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.737081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.737085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.737089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.737093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.737097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.737101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.737104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.737109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.737113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.737117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.737120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.737124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.737132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.737139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.737146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.737151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.737156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.737162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.737166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.737171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.737177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.737183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.737187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.737193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.737197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.737203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.737207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.737212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.737222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.737230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.737235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.737246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.737252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.737261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.737268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.737273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.737283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.737288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.737296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.737301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.737343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:55.751297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:55.752033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:55.752054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:55.752059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:55.752064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:55.752072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2382 [2:7556256632659335137:8666]
2025-10-01T14:14:55.752096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:55.752117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:55.752121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.752124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.752128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.752147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:55.752153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:55.752161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:55.752240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.752249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.752252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.752255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:55.752259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:55.752586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2382
2025-10-01T14:14:55.752587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2382
2025-10-01T14:14:55.752343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:55.752355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.752365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.752376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.752393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:55.752410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.752412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.752415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.752425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:55.752435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:55.752438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:55.752442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:55.752442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:55.752454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:55.752459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:55.752470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036244325:5601], now have 1 active actors on pipe
2025-10-01T14:14:55.752477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036244071:2446], now have 1 active actors on pipe
2025-10-01T14:14:55.752517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.752525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:55.752546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:55.752752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.752757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.752784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c679c6b2-44d97544-136d684f-714328b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:55.752790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.752795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.752798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:55.752813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.752825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:55.752839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.753063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.753077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.753100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.753235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2383 partition: 0 MaxSeqNo: 45 sessionId: src_id|c679c6b2-44d97544-136d684f-714328b6_0
2025-10-01T14:14:55.753634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d3c270-d73141e1-1ebd96d1-871144a2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c679c6b2-44d97544-136d684f-714328b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:55.756727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Write session: try to update token
2025-10-01T14:14:55.756749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:55.770149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId: src_id|c679c6b2-44d97544-136d684f-714328b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:55.773117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:55.773377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.773404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.773445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:55.773556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:55.777670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:55.777699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:55.777702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:55.777705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:55.777716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.777722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.777727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256632659335132:8666]
2025-10-01T14:14:55.777780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:55.777787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:55.777790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:55.777792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:55.777798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.777802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:55.778028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:55.807080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256635036244411:7265]
2025-10-01T14:14:55.807508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2382, pipe: [1:7556256635036244411:7265]
2025-10-01T14:14:55.921737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:55.932111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.932144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.932361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.932435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.932502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.932585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.933153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.933165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.933257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.933331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.933406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.933479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.933535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.933539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.933619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.933687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.933767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.933836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.933884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.933887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.933965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.934035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.934100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.934174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.934229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.934232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.934315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.934400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.934469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.934540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.934595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.934598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.934695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.934767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.934837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.934905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.938120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:55.938139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:55.938170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2383 reason: error at write: Disconnected sessionId: src_id|c679c6b2-44d97544-136d684f-714328b6_0
2025-10-01T14:14:55.938233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:55.938318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256635036244411:7265]
2025-10-01T14:14:55.935213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.938408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2383 sessionId: src_id|c679c6b2-44d97544-136d684f-714328b6_0 is DEAD
2025-10-01T14:14:55.935226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.935395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.935559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.935735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.935902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.935989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.935994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.936157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.936320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.936393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.936467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.936529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.936532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.936630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.936697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.936766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.936830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.936877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.936880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.936953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:55.937013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:55.937083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:55.937156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:55.937210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:55.937216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:55.937302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036244411:7265], now have 1 active actors on pipe
2025-10-01T14:14:55.937974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:55.938641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:55.938651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Write session will restart in 0.007627s
2025-10-01T14:14:55.938677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Write session: Do CDS request
2025-10-01T14:14:55.938685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:55.947991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.948181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:55.948201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2384
2025-10-01T14:14:55.948360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:55.948386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:55.948394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:55.948398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:55.948995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2384 sessionId:  describe result for acl check
2025-10-01T14:14:55.949066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:55.949068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:55.949073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:55.949080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256635036244429:5587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:55.949779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256635036244429:5587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:55.952482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256635036244429:5587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:55.955190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256635036244429:5587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:55.955207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256635036244429:5587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:55.955209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256635036244429:5587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:55.955216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:55.971522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:55.975038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:55.975296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:55.975300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:55.975312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:55.975369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:55.975416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256632659335389:8649]
2025-10-01T14:14:55.976093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:55.976574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:55.976630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:55.976954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:55.977020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.977021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.977023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.977025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.977026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.977027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.977029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.977030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.977032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.977033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.977034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.977036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.977037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.977039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.977044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.977054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.977059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.977063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.977067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.977071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.977075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.977079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.977082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.977086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.977091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.977095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.977099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.977102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.977110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.977118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:55.977124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.977129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:55.977134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.977140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:55.977145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.977150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:55.977156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.977161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:55.977166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.977172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:55.977177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.977182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:55.977187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.977192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:55.977197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.977202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:55.977207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.977211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.977216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.977221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.977226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.977232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.977236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.977241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:55.977246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.977251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:55.977292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:55.982577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:55.983819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2383
2025-10-01T14:14:55.983275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:55.983834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2383
2025-10-01T14:14:55.983282Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:55.983286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:55.983291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:55.983299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2383 [2:7556256632659335389:8649]
2025-10-01T14:14:55.983319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:55.983343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:55.983347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.983353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.983356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.983372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:55.983378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:55.983386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:55.983474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.983478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.983480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.983485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:55.983488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:55.983579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:55.983584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:55.983601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:55.983614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:55.983632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:55.983653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:55.983657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:55.983660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:55.983672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:55.983690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:55.983709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:55.983713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:55.983714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:55.983720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:55.983723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:55.983765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036244414:2446], now have 1 active actors on pipe
2025-10-01T14:14:55.983770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:55.983782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:55.983789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256635036244572:5587], now have 1 active actors on pipe
2025-10-01T14:14:55.983796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:55.984125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.984139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.984173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:55.984183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:55.984189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:55.984191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:55.984202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:55.984217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:55.984234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.984509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:55.984524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:55.984545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:55.984677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2384 partition: 0 MaxSeqNo: 45 sessionId: src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0
2025-10-01T14:14:55.985055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c679c6b2-44d97544-136d684f-714328b6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:55.988144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Write session: try to update token
2025-10-01T14:14:55.988164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:56.009392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:56.009417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:56.009422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:56.009424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:56.009435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:56.009441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:56.009445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256632659335383:8649]
2025-10-01T14:14:56.009498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:56.009505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.009508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:56.009509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:56.009520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:56.009529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:56.009659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:56.017515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId: src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:56.020132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:56.038440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256639331212066:7265]
2025-10-01T14:14:56.038720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2383, pipe: [1:7556256639331212066:7265]
2025-10-01T14:14:56.159777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:56.160661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.160681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.160724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212066:7265], now have 1 active actors on pipe
2025-10-01T14:14:56.160953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:56.161002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:56.161048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256639331212066:7265]
2025-10-01T14:14:56.161058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:56.161143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2384 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0
2025-10-01T14:14:56.161342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2384 sessionId: src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0 is DEAD
2025-10-01T14:14:56.161551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:56.161563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Write session will restart in 0.005659s
2025-10-01T14:14:56.161595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Write session: Do CDS request
2025-10-01T14:14:56.161602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:56.168865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.169197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:56.169225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2385
2025-10-01T14:14:56.169394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.169455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:56.169468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:56.169472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:56.169864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2385 sessionId:  describe result for acl check
2025-10-01T14:14:56.169896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:56.169898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:56.169900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:56.169904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256639331212084:5561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:56.170342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256639331212084:5561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:56.172273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256639331212084:5561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:56.174834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256639331212084:5561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:56.174853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256639331212084:5561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:56.174857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256639331212084:5561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:56.174865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:56.179430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:56.180764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:56.180935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:56.180945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:56.180955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:56.180991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:56.181020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256636954302906:8635]
2025-10-01T14:14:56.181600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:56.181855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:56.181899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:56.182130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:56.182175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.182181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.182181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.182182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.182183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.182183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.182184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.182185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.182185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.182186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.182187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.182187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.182188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.182188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.182192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.182198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.182200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.182203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.182205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.182207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.182209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.182211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.182213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.182216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.182218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.182221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.182224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.182228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.182235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.182242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.182248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.182253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.182257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.182262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.182266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.182271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.182274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.182277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.182291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.182294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.182298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.182301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.182304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.182306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.182309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.182311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.182314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.182316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.182320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.182323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.182325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.182328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.182330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.182333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.182335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.182338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.182358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:56.186038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:56.186670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:56.186685Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:56.186686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:56.186689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:56.186694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2384 [2:7556256636954302906:8635]
2025-10-01T14:14:56.186706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:56.186723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:56.186732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.186736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.186738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.186759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:56.186770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:56.186776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:56.186822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.186831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.186833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.186835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:56.186837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:56.186905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:56.186914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.186923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.186929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.186938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:56.186956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212242:5561], now have 1 active actors on pipe
2025-10-01T14:14:56.186963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212069:2446], now have 1 active actors on pipe
2025-10-01T14:14:56.186971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.186972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.186974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.186983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:56.186992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:56.186995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:56.186997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:56.186997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:56.187006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:56.187013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:56.187036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.187045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:56.187049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:56.187123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2384
2025-10-01T14:14:56.187133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2384
2025-10-01T14:14:56.187166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.187179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.187204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5a21028-4c3a3015-9395e779-41e354d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:56.187210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.187215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.187217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:56.187227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.187241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:56.187254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.187400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.187408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.187419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.187532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2385 partition: 0 MaxSeqNo: 45 sessionId: src_id|a5a21028-4c3a3015-9395e779-41e354d2_0
2025-10-01T14:14:56.187898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7631fd-104f29d2-507d4f42-1d01b62_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a5a21028-4c3a3015-9395e779-41e354d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:56.190641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Write session: try to update token
2025-10-01T14:14:56.190658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:56.207458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId: src_id|a5a21028-4c3a3015-9395e779-41e354d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:56.208767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:56.208783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:56.208784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:56.208786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:56.208793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.208796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.208800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256636954302901:8635]
2025-10-01T14:14:56.208842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:56.208844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:56.208847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.208849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:56.208850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:56.208853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:56.208976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:56.210040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:56.261160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256639331212411:7265]
2025-10-01T14:14:56.261379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2384, pipe: [1:7556256639331212411:7265]
2025-10-01T14:14:56.347032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:56.347241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.347256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.347291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212411:7265], now have 1 active actors on pipe
2025-10-01T14:14:56.347455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:56.347535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:56.347571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256639331212411:7265]
2025-10-01T14:14:56.347579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:56.347650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5a21028-4c3a3015-9395e779-41e354d2_0
2025-10-01T14:14:56.347830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2385 sessionId: src_id|a5a21028-4c3a3015-9395e779-41e354d2_0 is DEAD
2025-10-01T14:14:56.347992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:56.348005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Write session will restart in 0.005182s
2025-10-01T14:14:56.348033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Write session: Do CDS request
2025-10-01T14:14:56.348040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:56.354833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.356599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:56.356623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2386
2025-10-01T14:14:56.356783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.356820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:56.356832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:56.356837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:56.357304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2386 sessionId:  describe result for acl check
2025-10-01T14:14:56.357339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:56.357347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:56.357349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:56.357354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256639331212482:5556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:56.357939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256639331212482:5556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:56.359887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256639331212482:5556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:56.363800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256639331212482:5556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:56.363819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256639331212482:5556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:56.363823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256639331212482:5556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:56.363831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:56.371480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:56.373620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:56.373858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:56.373869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:56.373880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:56.373931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:56.373970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256636954303129:8640]
2025-10-01T14:14:56.374568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:56.374851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:56.374898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:56.375121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:56.375162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.375167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.375167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.375168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.375169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.375170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.375170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.375171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.375172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.375172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.375173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.375174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.375175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.375176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.375179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.375185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.375187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.375190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.375192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.375194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.375197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.375199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.375201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.375203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.375205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.375207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.375209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.375211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.375217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.375222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.375225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.375229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.375231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.375234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.375238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.375242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.375244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.375247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.375249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.375252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.375255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.375257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.375260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.375262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.375265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.375268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.375271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.375274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.375277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.375282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.375286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.375291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.375295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.375299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.375303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.375308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.375332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:56.379124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:56.380058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:56.380070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:56.380071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:56.380074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:56.380079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2385 [2:7556256636954303129:8640]
2025-10-01T14:14:56.380090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:56.380102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:56.380104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.380106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.380107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.380119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:56.380122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:56.380127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:56.380170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.380176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.380177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.380180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:56.380181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:56.380232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:56.380238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.380246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.380251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.380265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:56.380283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212589:5556], now have 1 active actors on pipe
2025-10-01T14:14:56.380292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.380297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.380298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.380306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:56.380315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:56.380315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:56.380324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:56.380325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:56.380326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:56.380327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:56.380330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212414:2446], now have 1 active actors on pipe
2025-10-01T14:14:56.380352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.380360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:56.380365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:56.380378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2385
2025-10-01T14:14:56.380381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2385
2025-10-01T14:14:56.380444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.380458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.380504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:56.380519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.380526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.380529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:56.380539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.380560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:56.380577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.380739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.380757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.380772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.380852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2386 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0
2025-10-01T14:14:56.381696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21028-4c3a3015-9395e779-41e354d2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:56.384589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Write session: try to update token
2025-10-01T14:14:56.384611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:56.407362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:56.407383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:56.407386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:56.407388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:56.407398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.407402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.407407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256636954303124:8640]
2025-10-01T14:14:56.407460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:56.407460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:56.407468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:56.407468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.407470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:56.407476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:56.407909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:56.409763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId: src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:56.412627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:56.447555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256639331212778:7265]
2025-10-01T14:14:56.447907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2385, pipe: [1:7556256639331212778:7265]
2025-10-01T14:14:56.549710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:56.550152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.550166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.550211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212778:7265], now have 1 active actors on pipe
2025-10-01T14:14:56.550394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:56.550504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:56.550529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256639331212778:7265]
2025-10-01T14:14:56.550552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:56.550630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2386 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0
2025-10-01T14:14:56.550859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2386 sessionId: src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0 is DEAD
2025-10-01T14:14:56.551013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:56.551027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Write session will restart in 0.007854s
2025-10-01T14:14:56.551057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Write session: Do CDS request
2025-10-01T14:14:56.551063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:56.559916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.560017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:56.560035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2387
2025-10-01T14:14:56.560229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.560260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:56.560265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:56.560268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:56.560590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2387 sessionId:  describe result for acl check
2025-10-01T14:14:56.560616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:56.560620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:56.560623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:56.560626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256639331213015:5526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:56.561037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256639331213015:5526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:56.563824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256639331213015:5526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:56.566999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:56.568408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256639331213015:5526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:56.568425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256639331213015:5526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:56.568428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256639331213015:5526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:56.568431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:56.568437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:56.568615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:56.568623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:56.568631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:56.568674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:56.568712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256636954303358:6423]
2025-10-01T14:14:56.569276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:56.569543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:56.569584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:56.569810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:56.569858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.569863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.569864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.569864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.569865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.569866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.569867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.569868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.569868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.569869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.569870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.569870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.569871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.569871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.569875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.569881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.569884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.569886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.569888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.569890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.569894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.569897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.569900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.569904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.569907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.569910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.569913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.569916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.569922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.569929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.569935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.569941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.569947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.569950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.569952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.569956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.569959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.569961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.569964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.569967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.569969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.569973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.569976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.569979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.569981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.569984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.569986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.569989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.569992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.569994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.569998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.570001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.570004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.570007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.570009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.570012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.570035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:56.573653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:56.574277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:56.574289Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:56.574291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:56.574295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:56.574301Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2386 [2:7556256636954303358:6423]
2025-10-01T14:14:56.574316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:56.574333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:56.574336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.574340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.574342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.574357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:56.574362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:56.574394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:56.574445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.574452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.574453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.574456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:56.574458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:56.574511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:56.574519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.574529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.574539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.574558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:56.574579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213127:5526], now have 1 active actors on pipe
2025-10-01T14:14:56.574586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331212793:2446], now have 1 active actors on pipe
2025-10-01T14:14:56.574593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.574599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.574602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.574610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:56.574625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:56.574641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:56.574645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:56.574646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:56.574648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:56.574648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:56.574660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2386
2025-10-01T14:14:56.574661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2386
2025-10-01T14:14:56.574684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.574694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:56.574695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:56.574711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.574714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.574758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af19ba76-48e012d-224134ef-45e39188_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:56.574769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.574777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.574780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:56.574787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.574800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:56.574820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.574948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.574954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.574968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.575059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2387 partition: 0 MaxSeqNo: 45 sessionId: src_id|af19ba76-48e012d-224134ef-45e39188_0
2025-10-01T14:14:56.575401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca74fee-2cd9a352-a6337f3f-e486070f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|af19ba76-48e012d-224134ef-45e39188_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:56.578164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Write session: try to update token
2025-10-01T14:14:56.578184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:56.595537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:56.595556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:56.595558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:56.595561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:56.595572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.595578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.595582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256636954303352:6423]
2025-10-01T14:14:56.595622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:56.595630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:56.595634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:56.595637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.595638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:56.595640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:56.595776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:56.596191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId: src_id|af19ba76-48e012d-224134ef-45e39188_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:56.599060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:56.650804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256639331213144:7265]
2025-10-01T14:14:56.651070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2386, pipe: [1:7556256639331213144:7265]
2025-10-01T14:14:56.738306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:56.738912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.738931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.738972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213144:7265], now have 1 active actors on pipe
2025-10-01T14:14:56.739188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:56.739210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:56.739221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256639331213144:7265]
2025-10-01T14:14:56.739240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:56.739267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2387 reason: error at write: Disconnected sessionId: src_id|af19ba76-48e012d-224134ef-45e39188_0
2025-10-01T14:14:56.739424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2387 sessionId: src_id|af19ba76-48e012d-224134ef-45e39188_0 is DEAD
2025-10-01T14:14:56.739603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:56.739618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Write session will restart in 0.009833s
2025-10-01T14:14:56.739645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Write session: Do CDS request
2025-10-01T14:14:56.739651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:56.739819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:56.752051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.752204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:56.752226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2388
2025-10-01T14:14:56.752929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:56.752410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.752444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:56.752449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:56.752453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:56.752862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2388 sessionId:  describe result for acl check
2025-10-01T14:14:56.752890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:56.752892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:56.752893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:56.752899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256639331213445:5503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:56.753487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256639331213445:5503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:56.754664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:56.754858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:56.754867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:56.754877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:56.754924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:56.754963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256636954303593:8632]
2025-10-01T14:14:56.755517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:56.755869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:56.755924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:56.756231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:56.756296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.756302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.756303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.756304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.756305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.756306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.756307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.756308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.756309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.756311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.756312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.756313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.756315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.756316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.756321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.756330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.756334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.756337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.756340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.756343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.756346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.756349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.756353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.756357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.756360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.756363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.756365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.756368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.756376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.756382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.756387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.756392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.756396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.756400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.756406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.756410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.756415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.756419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.756423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.756428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.756433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.756437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.756441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.756446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.756451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.756461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.756465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.756470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.756475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.756479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.756458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256639331213445:5503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:56.756483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.756492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.756497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.756501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.756505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.756509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.756542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:56.760108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256639331213445:5503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:56.760131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256639331213445:5503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:56.760135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256639331213445:5503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:56.760145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:56.760352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:56.761451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:56.761464Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:56.761466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:56.761470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:56.761476Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2387 [2:7556256636954303593:8632]
2025-10-01T14:14:56.761490Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:56.761504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:56.761506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.761508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.761511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.761529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:56.761539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:56.761544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:56.761599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.761602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.761604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.761606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:56.761611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:56.761677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:56.761683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.761696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.761707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.761725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:56.761748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213146:2446], now have 1 active actors on pipe
2025-10-01T14:14:56.761755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213484:5503], now have 1 active actors on pipe
2025-10-01T14:14:56.761762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.761764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.761766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.761779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:56.761786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:56.761789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:56.761791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:56.761796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:56.761809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:56.761817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:56.761852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.761865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:56.761849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2387
2025-10-01T14:14:56.761896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:56.761858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2387
2025-10-01T14:14:56.761987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.762000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.762027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:56.762035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.762042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.762044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:56.762054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.762067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:56.762086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.762291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.762304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.762328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.762479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2388 partition: 0 MaxSeqNo: 45 sessionId: src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0
2025-10-01T14:14:56.762877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af19ba76-48e012d-224134ef-45e39188_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:56.765791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Write session: try to update token
2025-10-01T14:14:56.765806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:56.787689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:56.787709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:56.787712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:56.787714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:56.787724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.787729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.787734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256636954303587:8632]
2025-10-01T14:14:56.787781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:56.787786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:56.787787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:56.787795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.787798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:56.787803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:56.787947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:56.788168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId: src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:56.790746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:56.839205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256639331213492:7265]
2025-10-01T14:14:56.839463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2387, pipe: [1:7556256639331213492:7265]
2025-10-01T14:14:56.951073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:56.951373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.951389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.951436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213492:7265], now have 1 active actors on pipe
2025-10-01T14:14:56.951592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:56.951643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256639331213492:7265]
2025-10-01T14:14:56.952216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:56.952250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Write session will restart in 0.007358s
2025-10-01T14:14:56.951676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:56.951710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:56.951781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2388 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0
2025-10-01T14:14:56.952014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2388 sessionId: src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0 is DEAD
2025-10-01T14:14:56.952290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Write session: Do CDS request
2025-10-01T14:14:56.952298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:56.961870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.961973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:56.962002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2389
2025-10-01T14:14:56.962141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:56.962187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:56.962196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:56.962200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:56.962780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2389 sessionId:  describe result for acl check
2025-10-01T14:14:56.962820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:56.962828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:56.962830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:56.962836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256639331213583:5477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:56.963411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256639331213583:5477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:56.966128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256639331213583:5477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:56.969744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256639331213583:5477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:56.969761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256639331213583:5477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:56.969765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256639331213583:5477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:56.969773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:56.971965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:56.973544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:56.973734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:56.973743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:56.973753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:56.973795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:56.973835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256636954303850:8611]
2025-10-01T14:14:56.974279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:56.974555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:56.974603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:56.974948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:56.975025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.975033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.975034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.975036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.975037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.975039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.975040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.975041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.975042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.975044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.975045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.975046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.975047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.975048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.975055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.975064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.975069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.975073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.975076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.975080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.975083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.975087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.975091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.975095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.975098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.975102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.975105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.975109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.975117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.975125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:56.975131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.975137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:56.975141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.975146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:56.975151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.975157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:56.975162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.975167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:56.975172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.975177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:56.975182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.975188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:56.975192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.975197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:56.975201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.975207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:56.975219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.975226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.975236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.975241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.975251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.975255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.975265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.975271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:56.975275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.975280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:56.975321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:56.979166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:56.979816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:56.979833Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:56.979835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:56.979838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:56.979845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2388 [2:7556256636954303850:8611]
2025-10-01T14:14:56.979862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:56.979883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:56.979888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.979891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.979893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.979905Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:56.979912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:56.979917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:56.979960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.979965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.979967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.979981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:56.979983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:56.980038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:56.980044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:56.980052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:56.980063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:56.980080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:56.980104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213838:5477], now have 1 active actors on pipe
2025-10-01T14:14:56.980112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256639331213497:2446], now have 1 active actors on pipe
2025-10-01T14:14:56.980119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:56.980124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:56.980126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:56.980137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:56.980148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:56.980150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:56.980154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:56.980155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:56.980160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:56.980163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:56.980185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:56.980193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:56.980197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:56.980220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2388
2025-10-01T14:14:56.980225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2388
2025-10-01T14:14:56.980269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.980277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.980300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a039f321-caae03e5-368f24ee-74eade4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:56.980309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:56.980312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:56.980314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:56.980322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:56.980330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:56.980345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.980529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:56.980534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:56.980545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:56.980669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2389 partition: 0 MaxSeqNo: 45 sessionId: src_id|a039f321-caae03e5-368f24ee-74eade4a_0
2025-10-01T14:14:56.980981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c461e617-59f1efa8-49ab79c7-8ed90740_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a039f321-caae03e5-368f24ee-74eade4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:56.983719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Write session: try to update token
2025-10-01T14:14:56.983734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:56.999237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId: src_id|a039f321-caae03e5-368f24ee-74eade4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:57.000753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:57.000771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:57.000773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:57.000776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:57.000785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:57.001139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:57.001148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256636954303845:8611]
2025-10-01T14:14:57.001190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:57.001199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.001200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:57.001205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:57.001214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:57.001217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:57.001340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:57.001949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:57.051724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256643626181151:7265]
2025-10-01T14:14:57.052026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2388, pipe: [1:7556256643626181151:7265]
2025-10-01T14:14:57.142501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:57.142750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.142763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.142805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181151:7265], now have 1 active actors on pipe
2025-10-01T14:14:57.143020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:57.143078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256643626181151:7265]
2025-10-01T14:14:57.143117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:57.143201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a039f321-caae03e5-368f24ee-74eade4a_0
2025-10-01T14:14:57.143389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2389 sessionId: src_id|a039f321-caae03e5-368f24ee-74eade4a_0 is DEAD
2025-10-01T14:14:57.143510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:57.143521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Write session will restart in 0.005583s
2025-10-01T14:14:57.143547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Write session: Do CDS request
2025-10-01T14:14:57.143553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:57.143588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:57.149825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.149988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:57.150017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2390
2025-10-01T14:14:57.150188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.150214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:57.150221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:57.150225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:57.150632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2390 sessionId:  describe result for acl check
2025-10-01T14:14:57.150667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:57.150673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:57.150675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:57.150681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256643626181190:5456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:57.151202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256643626181190:5456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:57.154361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256643626181190:5456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:57.159466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256643626181190:5456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:57.159489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256643626181190:5456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:57.159494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256643626181190:5456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:57.159504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:57.168322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:57.170096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:57.170282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:57.170294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:57.170306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:57.170364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:57.170423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256641249271371:8609]
2025-10-01T14:14:57.170987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:57.171286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:57.171334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:57.171647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:57.171743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.171750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.171751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.171752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.171753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.171754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.171755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.171757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.171758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.171759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.171760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.171761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.171763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.171764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.171770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.171779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.171783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.171787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.171791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.171794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.171797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.171801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.171805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.171808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.171812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.171815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.171819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.171823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.171831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.171838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.171845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.171849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.171854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.171859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.171863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.171874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.171879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.171884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.171892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.171897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.171902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.171906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.171910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.171915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.171920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.171925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.171929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.171933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.171938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.171943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.171949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.171954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.171960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.171965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.171970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.171975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.172013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:57.176269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:57.177312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:57.177326Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:57.177328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:57.177331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:57.177336Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2389 [2:7556256641249271371:8609]
2025-10-01T14:14:57.177349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:57.177363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:57.177365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.177367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.177368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.177381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:57.177384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:57.177389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:57.177437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.177438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.177440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.177442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:57.177444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:57.177497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:57.177503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.177511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.177517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.177526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:57.177537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.177542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.177544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.177550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:57.177559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:57.177562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181156:2446], now have 1 active actors on pipe
2025-10-01T14:14:57.177566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181320:5456], now have 1 active actors on pipe
2025-10-01T14:14:57.177566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:57.177568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:57.177571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:57.177579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:57.177581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:57.177612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.177624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:57.177631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:57.177645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2389
2025-10-01T14:14:57.177694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2389
2025-10-01T14:14:57.177755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.177766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.177790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:57.177800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.177807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.177809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:57.177816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.177829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:57.177844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.177950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.177957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.177972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.178039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2390 partition: 0 MaxSeqNo: 45 sessionId: src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0
2025-10-01T14:14:57.178392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a039f321-caae03e5-368f24ee-74eade4a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:57.181139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Write session: try to update token
2025-10-01T14:14:57.181158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:57.194390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:57.194410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:57.194421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.194472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:57.194487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:57.194654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:57.194810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:57.194956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:57.195098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:57.195296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:57.195342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:57.196798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId: src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:57.199524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:57.199769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.199792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.199830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:57.199919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:57.207746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:57.207769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:57.207773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:57.207775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:57.207785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.207790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.207794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256641249271366:8609]
2025-10-01T14:14:57.207841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:57.207848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:57.207854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.207855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:57.207857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:57.207859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:57.207981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:57.243222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256643626181504:7265]
2025-10-01T14:14:57.243444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2389, pipe: [1:7556256643626181504:7265]
2025-10-01T14:14:57.344857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:57.354917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.354946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.355147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.355230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.355313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.355393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.355453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.355464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.355564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.355650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.355734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.355819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.355879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.355887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.355976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.356057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.356141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.356229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.356289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.356298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.356389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.356474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.356577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.356668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.356726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.356734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.356821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.356902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.356985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.357065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.357119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.357126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.357212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.357293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.357377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.357461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.357528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.357537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.357624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.357700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.357789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.357871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.357922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.357936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.358023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.358101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.358181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.358257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.358307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.358310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.358474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.358557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.358643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.358725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.358786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.358794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.358875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:57.358957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:57.359035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:57.359115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:57.359171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:57.359180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:57.359258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181504:7265], now have 1 active actors on pipe
2025-10-01T14:14:57.361242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256643626181504:7265]
2025-10-01T14:14:57.361284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:57.361328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:57.361394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0
2025-10-01T14:14:57.361609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2390 sessionId: src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0 is DEAD
2025-10-01T14:14:57.361803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:57.361816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Write session will restart in 0.005382s
2025-10-01T14:14:57.361852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Write session: Do CDS request
2025-10-01T14:14:57.361857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:57.361177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:57.368914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.369012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:57.369045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2391
2025-10-01T14:14:57.369358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.369435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:57.369446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:57.369451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:57.370034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2391 sessionId:  describe result for acl check
2025-10-01T14:14:57.370086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:57.370092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:57.370095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:57.370101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256643626181522:5435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:57.370714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256643626181522:5435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:57.375746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256643626181522:5435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:57.383122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256643626181522:5435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:57.383152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256643626181522:5435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:57.383156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256643626181522:5435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:57.383167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:57.385426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:57.387818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:57.388088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:57.388104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:57.388118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:57.388203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:57.388251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256641249271599:8608]
2025-10-01T14:14:57.389028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:57.389406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:57.389473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:57.389886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:57.389979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.389987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.389989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.389990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.389992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.389993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.389994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.389995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.389996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.389998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.389999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.390001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.390002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.390003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.390010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.390022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.390027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.390032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.390036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.390041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.390045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.390050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.390055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.390059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.390063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.390068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.390072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.390076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.390086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.390095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.390103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.390110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.390115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.390121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.390126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.390142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.390148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.390160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.390165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.390171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.390183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.390188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.390193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.390199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.390210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.390216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.390226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.390232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.390244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.390250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.390262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.390269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.390278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.390284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.390288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.390294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.390344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:57.394332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:57.394990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:57.395002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:57.395004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:57.395007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:57.395012Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2390 [2:7556256641249271599:8608]
2025-10-01T14:14:57.395023Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:57.395036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:57.395041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.395044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.395045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.395056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:57.395060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:57.395064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:57.395107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.395112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.395113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.395116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:57.395118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:57.395169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:57.395177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.395185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.395190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.395199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:57.395213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181840:5435], now have 1 active actors on pipe
2025-10-01T14:14:57.395216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181507:2446], now have 1 active actors on pipe
2025-10-01T14:14:57.395221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.395227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.395229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.395239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:57.395248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:57.395260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:57.395266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:57.395273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:57.395286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:57.395287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.395288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:57.395289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:57.395295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:57.395365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.395373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.395314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2390
2025-10-01T14:14:57.395394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70195671-8e89dd0-58275b04-8047b210_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:57.395403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.395339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2390
2025-10-01T14:14:57.395406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.395407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:57.395415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.395421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:57.395433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.395552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.395558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.395568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.395634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2391 partition: 0 MaxSeqNo: 45 sessionId: src_id|70195671-8e89dd0-58275b04-8047b210_0
2025-10-01T14:14:57.395998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b12eb20-35926bee-c036358-e2fc6b8b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|70195671-8e89dd0-58275b04-8047b210_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:57.398906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Write session: try to update token
2025-10-01T14:14:57.398924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:57.415765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:57.415787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:57.415790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:57.415791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:57.415802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.415807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.415811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256641249271594:8608]
2025-10-01T14:14:57.415857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:57.415857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:57.415864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:57.415867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.415869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:57.415870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:57.416006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:57.418224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId: src_id|70195671-8e89dd0-58275b04-8047b210_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:57.421109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:57.461315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256643626181855:7265]
2025-10-01T14:14:57.461587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2390, pipe: [1:7556256643626181855:7265]
2025-10-01T14:14:57.569312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:57.569941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.569958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.569999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181855:7265], now have 1 active actors on pipe
2025-10-01T14:14:57.570265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256643626181855:7265]
2025-10-01T14:14:57.570274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:57.570278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:57.570322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:57.570348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2391 reason: error at write: Disconnected sessionId: src_id|70195671-8e89dd0-58275b04-8047b210_0
2025-10-01T14:14:57.570548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2391 sessionId: src_id|70195671-8e89dd0-58275b04-8047b210_0 is DEAD
2025-10-01T14:14:57.570729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:57.570741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Write session will restart in 0.008721s
2025-10-01T14:14:57.570768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Write session: Do CDS request
2025-10-01T14:14:57.570778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:57.571065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:57.580849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.580963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:57.580981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2392
2025-10-01T14:14:57.581090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.581119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:57.581131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:57.581134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:57.581519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2392 sessionId:  describe result for acl check
2025-10-01T14:14:57.581548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:57.581559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:57.581560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:57.581564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256643626182167:5411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:57.581940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256643626182167:5411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:57.583174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:57.583793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256643626182167:5411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:57.585098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:57.585307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:57.585316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:57.585326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:57.585379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:57.585416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256641249271844:8599]
2025-10-01T14:14:57.585983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:57.586206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:57.586247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:57.586253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256643626182167:5411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:57.586268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256643626182167:5411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:57.586270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256643626182167:5411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:57.586276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:57.586541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:57.586608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.586613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.586614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.586615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.586616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.586617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.586618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.586619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.586620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.586621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.586622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.586623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.586624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.586625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.586630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.586639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.586643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.586646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.586650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.586654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.586658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.586662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.586665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.586669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.586672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.586676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.586679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.586682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.586689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.586698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.586704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.586709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.586713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.586718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.586722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.586732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.586736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.586741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.586745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.586750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.586756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.586765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.586769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.586773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.586782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.586787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.586795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.586800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.586804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.586813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.586817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.586825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.586831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.586840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.586844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.586850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.586885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:57.590318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:57.591103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:57.591117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:57.591120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:57.591124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:57.591130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2391 [2:7556256641249271844:8599]
2025-10-01T14:14:57.591147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:57.591167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:57.591174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.591177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.591180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.591195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:57.591207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:57.591213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:57.591268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.591274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.591277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.591280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:57.591282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:57.591346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:57.591353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.591364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.591378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.591396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:57.591418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182222:5411], now have 1 active actors on pipe
2025-10-01T14:14:57.591427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626181885:2446], now have 1 active actors on pipe
2025-10-01T14:14:57.591434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.591436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.591438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.591452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:57.591460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:57.591463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:57.591466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:57.591470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:57.591445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2391
2025-10-01T14:14:57.591483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:57.591490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:57.591477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2391
2025-10-01T14:14:57.591533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.591541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.591553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.591564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:57.591567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:57.591592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcdbba2-50470db5-705ee29b-ad519d27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:57.591603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.591612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.591619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:57.591628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.591639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:57.591665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.591795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.591801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.591815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.591869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2392 partition: 0 MaxSeqNo: 45 sessionId: src_id|bcdbba2-50470db5-705ee29b-ad519d27_0
2025-10-01T14:14:57.592204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70195671-8e89dd0-58275b04-8047b210_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bcdbba2-50470db5-705ee29b-ad519d27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:57.594772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Write session: try to update token
2025-10-01T14:14:57.594784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:57.608867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId: src_id|bcdbba2-50470db5-705ee29b-ad519d27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:57.611264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:57.611307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:57.611325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:57.611328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:57.611329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:57.611338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.611343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.611346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256641249271839:8599]
2025-10-01T14:14:57.611384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:57.611396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:57.611399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:57.611402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.611411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.611430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:57.611441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.611443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:57.611556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:57.670685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256643626182237:7265]
2025-10-01T14:14:57.670957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2391, pipe: [1:7556256643626182237:7265]
2025-10-01T14:14:57.746328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:57.746777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182237:7265], now have 1 active actors on pipe
2025-10-01T14:14:57.746962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:57.747001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:57.747019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:57.747079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2392 reason: error at write: Disconnected sessionId: src_id|bcdbba2-50470db5-705ee29b-ad519d27_0
2025-10-01T14:14:57.747120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:57.747174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256643626182237:7265]
2025-10-01T14:14:57.747263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2392 sessionId: src_id|bcdbba2-50470db5-705ee29b-ad519d27_0 is DEAD
2025-10-01T14:14:57.747401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:57.747413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Write session will restart in 0.008799s
2025-10-01T14:14:57.747452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Write session: Do CDS request
2025-10-01T14:14:57.747459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:57.757937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.758094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:57.758123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2393
2025-10-01T14:14:57.758329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.758424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:57.758436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:57.758442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:57.759004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2393 sessionId:  describe result for acl check
2025-10-01T14:14:57.759055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:57.759057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:57.759064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:57.759070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256643626182501:5387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:57.759786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256643626182501:5387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:57.761618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:57.761907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256643626182501:5387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:57.763479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:57.763689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:57.763703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:57.763730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:57.763795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:57.763857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256641249272074:8592]
2025-10-01T14:14:57.764398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256643626182501:5387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:57.764417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256643626182501:5387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:57.764419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256643626182501:5387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:57.764435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:57.764427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:57.764787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:57.764843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:57.765152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:57.765234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.765242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.765243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.765245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.765246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.765247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.765248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.765249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.765250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.765252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.765253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.765254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.765255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.765257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.765263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.765273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.765278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.765281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.765284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.765288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.765292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.765295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.765299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.765303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.765306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.765309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.765312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.765316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.765324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.765332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.765344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.765350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.765359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.765364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.765374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.765379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.765388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.765392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.765397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.765406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.765411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.765421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.765425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.765434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.765438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.765443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.765451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.765455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.765460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.765468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.765472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.765476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.765486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.765490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.765497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.765502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.765542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:57.769051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:57.769952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:57.769965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:57.769967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:57.769970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:57.769977Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2392 [2:7556256641249272074:8592]
2025-10-01T14:14:57.769991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:57.770014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:57.770022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.770025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.770028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.770043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:57.770053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:57.770058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:57.770110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.770117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.770118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.770120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:57.770122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:57.770174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:57.770180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.770187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.770193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.770201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:57.770218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.770222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.770224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.770230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:57.770238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:57.770243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182239:2446], now have 1 active actors on pipe
2025-10-01T14:14:57.770247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:57.770249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:57.770250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:57.770257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:57.770261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:57.770266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182578:5387], now have 1 active actors on pipe
2025-10-01T14:14:57.770292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.770303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:57.770309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:57.770331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2392
2025-10-01T14:14:57.770332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2392
2025-10-01T14:14:57.770412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.770421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.770441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:57.770450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.770453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.770456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:57.770465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.770478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:57.770498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.770660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.770670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.770684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.770774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2393 partition: 0 MaxSeqNo: 45 sessionId: src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0
2025-10-01T14:14:57.771142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdbba2-50470db5-705ee29b-ad519d27_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:57.774102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Write session: try to update token
2025-10-01T14:14:57.774115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:57.790867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:57.790890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:57.790893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:57.790896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:57.790907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.790912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.790917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256641249272068:8592]
2025-10-01T14:14:57.790969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:57.790972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:57.790979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:57.790982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.790984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:57.790985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:57.791122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:57.801256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId: src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:57.804419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:57.847364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256643626182590:7265]
2025-10-01T14:14:57.847673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2392, pipe: [1:7556256643626182590:7265]
2025-10-01T14:14:57.941915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:57.942357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.942388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.942411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182590:7265], now have 1 active actors on pipe
2025-10-01T14:14:57.942680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:57.942706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:57.942710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:57.942746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256643626182590:7265]
2025-10-01T14:14:57.942762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2393 reason: error at write: Disconnected sessionId: src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0
2025-10-01T14:14:57.942630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:57.942941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2393 sessionId: src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0 is DEAD
2025-10-01T14:14:57.943116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:57.943128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Write session will restart in 0.005642s
2025-10-01T14:14:57.943158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Write session: Do CDS request
2025-10-01T14:14:57.943165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:57.949957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.950010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:57.950027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2394
2025-10-01T14:14:57.950252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:57.950297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:57.950308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:57.950312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:57.950686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2394 sessionId:  describe result for acl check
2025-10-01T14:14:57.950719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:57.950726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:57.950727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:57.950733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256643626182627:5381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:57.951225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256643626182627:5381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:57.953345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256643626182627:5381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:57.960324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256643626182627:5381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:57.960348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256643626182627:5381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:57.960351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256643626182627:5381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:57.960359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:57.971895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:57.973973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:57.974205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:57.974216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:57.974228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:57.974279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:57.974320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256641249272335:8578]
2025-10-01T14:14:57.974998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:57.975489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:57.975536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:57.975877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:57.975929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.975931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.975932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.975933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.975935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.975936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.975938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.975940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.975941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.975942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.975944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.975945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.975946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.975947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.975953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.975964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.975968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.975973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.975977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.975982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.975987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.975991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.975995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.975999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.976003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.976007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.976011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.976014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.976022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.976030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:57.976037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.976043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:57.976048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.976055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:57.976059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.976065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:57.976070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.976076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:57.976081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.976088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:57.976092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.976100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:57.976103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.976108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:57.976113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.976118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:57.976124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.976130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.976135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.976155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.976160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.976166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.976171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.976177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:57.976181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.976190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:57.976235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:57.981870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:57.982708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:57.982723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:57.982726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:57.982729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:57.982736Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2393 [2:7556256641249272335:8578]
2025-10-01T14:14:57.982755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:57.982774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:57.982782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.982785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.982787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.982806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:57.982811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:57.982817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:57.982882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.982884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.983153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2393
2025-10-01T14:14:57.982887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.983192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2393
2025-10-01T14:14:57.982890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:57.982892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:57.982963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:57.982966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:57.982976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:57.982987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:57.983001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:57.983017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182798:5381], now have 1 active actors on pipe
2025-10-01T14:14:57.983020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256643626182594:2446], now have 1 active actors on pipe
2025-10-01T14:14:57.983028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:57.983030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:57.983032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:57.983046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:57.983059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:57.983074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:57.983077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:57.983078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:57.983081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:57.983084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:57.983111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:57.983118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:57.983123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:57.983253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.983259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.983287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e654f326-b68de6de-16c8f609-23145925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:57.983295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:57.983299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:57.983301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:57.983311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:57.983321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:57.983338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.983497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:57.983506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:57.983530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:57.983698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2394 partition: 0 MaxSeqNo: 45 sessionId: src_id|e654f326-b68de6de-16c8f609-23145925_0
2025-10-01T14:14:57.984075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f63ebe-70c1f48a-a8c5e629-4deba46b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e654f326-b68de6de-16c8f609-23145925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:57.987085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Write session: try to update token
2025-10-01T14:14:57.987107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:58.012566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:58.012587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.012590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:58.012592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:58.012602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:58.012607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:58.012611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256641249272330:8578]
2025-10-01T14:14:58.012666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:58.012678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:58.012680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.012683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:58.012685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:58.012689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:58.012848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:58.013217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId: src_id|e654f326-b68de6de-16c8f609-23145925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:58.015869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:58.045961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256647921150253:7265]
2025-10-01T14:14:58.046324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2393, pipe: [1:7556256647921150253:7265]
2025-10-01T14:14:58.169132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:58.170123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.170132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.170173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150253:7265], now have 1 active actors on pipe
2025-10-01T14:14:58.171999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:58.172019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:58.172088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2394 reason: error at write: Disconnected sessionId: src_id|e654f326-b68de6de-16c8f609-23145925_0
2025-10-01T14:14:58.172296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2394 sessionId: src_id|e654f326-b68de6de-16c8f609-23145925_0 is DEAD
2025-10-01T14:14:58.172484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:58.172527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256647921150253:7265]
2025-10-01T14:14:58.174524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:58.179310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:58.179325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Write session will restart in 0.006575s
2025-10-01T14:14:58.179358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Write session: Do CDS request
2025-10-01T14:14:58.179363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:58.188486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.188666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:58.188685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2395
2025-10-01T14:14:58.189603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.189649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:58.189654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:58.189660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:58.190108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2395 sessionId:  describe result for acl check
2025-10-01T14:14:58.190162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:58.190164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:58.190165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:58.190171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256647921150266:5361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:58.190723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256647921150266:5361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:58.195886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256647921150266:5361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:58.200359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256647921150266:5361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:58.200379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256647921150266:5361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:58.200384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256647921150266:5361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:58.200393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:58.234940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:58.238843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:58.239017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:58.239021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:58.239029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:58.239075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:58.239102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256645544239863:8575]
2025-10-01T14:14:58.239539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:58.239944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:58.240009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:58.240357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:58.240420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.240421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.240423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.240423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.240425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.240426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.240428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.240429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.240430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.240432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.240433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.240434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.240435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.240436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.240442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.240453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.240458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.240462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.240466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.240471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.240474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.240478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.240482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.240487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.240491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.240495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.240499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.240503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.240511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.240520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.240527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.240533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.240538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.240543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.240564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.240569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.240589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.240595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.240601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.240607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.240612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.240618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.240623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.240630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.240638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.240645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.240650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.240655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.240660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.240665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.240669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.240674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.240679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.240684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.240691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.240697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.240739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:58.250504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:58.251589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:58.251596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:58.251599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:58.251603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:58.251611Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2394 [2:7556256645544239863:8575]
2025-10-01T14:14:58.251630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:58.251648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:58.251652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.251657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.251660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.251678Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:58.251685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:58.251692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:58.251755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.251758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.251761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.251765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:58.251768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:58.251855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:58.251858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.251873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.251885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.251902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:58.251920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.251923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.251925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.251939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:58.251956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:58.251973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:58.251976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:58.252021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.252025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:58.252369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:58.252381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:58.252383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:58.252389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:58.252819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150256:2446], now have 1 active actors on pipe
2025-10-01T14:14:58.252828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150306:5361], now have 1 active actors on pipe
2025-10-01T14:14:58.254957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2394
2025-10-01T14:14:58.255004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2394
2025-10-01T14:14:58.257953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.257971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.258009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:58.258020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.258026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.258029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:58.258045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.258062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:58.258082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.258915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2395 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0
2025-10-01T14:14:58.258313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.258323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.258343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.259439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e654f326-b68de6de-16c8f609-23145925_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:58.262643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Write session: try to update token
2025-10-01T14:14:58.262657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:58.274439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256647921150606:7265]
2025-10-01T14:14:58.277081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150606:7265], now have 1 active actors on pipe
2025-10-01T14:14:58.277942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2394, pipe: [1:7556256647921150606:7265]
2025-10-01T14:14:58.293313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:58.293344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.293359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.293424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:58.293796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:58.293945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:58.294089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:58.294237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:58.294517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:58.294565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:58.295042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:58.308012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId: src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:58.310751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:58.311971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.311997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.312041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:58.312655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:58.329924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:58.329950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.329952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:58.329954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:58.329966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.329970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.329974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256645544239855:8575]
2025-10-01T14:14:58.330027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:58.330037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.330039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:58.330316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:58.330793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:58.330812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:58.330818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:58.493012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:58.503935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.503966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.504176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.504250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.504325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.504397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.504453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.504467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.504568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.504639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.504709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.504781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.504834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.504843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.504910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.504980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.505051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.505117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.505171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.505179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.505243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.505314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.505383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.505461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.505511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.505514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.505583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.505647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.505712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.505785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.505839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.505842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.505932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.506009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.506095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.506183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.506238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.506241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.506321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.506430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.506510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.506592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.506649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.506651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.506748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.506821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.506897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.506972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.507032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.507035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.507122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.507195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.507271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.507350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.507403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.507407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.507493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.507564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.507646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.507729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.507785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.507788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.509179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:58.509355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:58.509367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Write session will restart in 0.007778s
2025-10-01T14:14:58.509396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Write session: Do CDS request
2025-10-01T14:14:58.509402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:58.508929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:58.508948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:58.508979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2395 reason: error at write: Disconnected sessionId: src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0
2025-10-01T14:14:58.509216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2395 sessionId: src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0 is DEAD
2025-10-01T14:14:58.509378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:58.509414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256647921150606:7265]
2025-10-01T14:14:58.517824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.519467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:58.519488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2396
2025-10-01T14:14:58.519826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.519865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:58.519877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:58.519881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:58.520465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2396 sessionId:  describe result for acl check
2025-10-01T14:14:58.520504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:58.520510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:58.520513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:58.520518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256647921150636:5334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:58.521117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256647921150636:5334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:58.528448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256647921150636:5334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:58.533626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256647921150636:5334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:58.533653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256647921150636:5334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:58.533657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256647921150636:5334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:58.533668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:58.544898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:58.547395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:58.547642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:58.547653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:58.547665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:58.547716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:58.547764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256645544240096:8568]
2025-10-01T14:14:58.548179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:58.548452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:58.548481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:58.548794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:58.548827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.548828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.548829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.548829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.548830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.548831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.548832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.548833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.548834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.548835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.548835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.548836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.548837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.548837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.548841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.548846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.548848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.548850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.548852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.548855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.548857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.548859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.548861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.548863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.548865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.548867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.548870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.548872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.548876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.548880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.548884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.548887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.548891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.548894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.548897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.548900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.548902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.548905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.548907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.548910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.548913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.548916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.548918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.548921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.548924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.548926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.548929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.548932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.548935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.548939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.548941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.548944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.548947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.548950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.548952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.548954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.548977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:58.552882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:58.553993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:58.554008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:58.554011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:58.554014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:58.554021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2395 [2:7556256645544240096:8568]
2025-10-01T14:14:58.554038Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:58.554055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:58.554058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.554062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.554064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.554080Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:58.554085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:58.554091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:58.554148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.554150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.554152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.554156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:58.554158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:58.554230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:58.554240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.554252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.554265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.554288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:58.554307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150787:5334], now have 1 active actors on pipe
2025-10-01T14:14:58.554312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150614:2446], now have 1 active actors on pipe
2025-10-01T14:14:58.554319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.554321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.554323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.554336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:58.554347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:58.554349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:58.554349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:58.554351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:58.554365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:58.554384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:58.554417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.554427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:58.554446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:58.554653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2395
2025-10-01T14:14:58.554693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2395
2025-10-01T14:14:58.554945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.554960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.554992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a048703a-2187554f-2fbf76eb-a5622737_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:58.555001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.555006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.555008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:58.555018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.555028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:58.555045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.556643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.556657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.556681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.556895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2396 partition: 0 MaxSeqNo: 45 sessionId: src_id|a048703a-2187554f-2fbf76eb-a5622737_0
2025-10-01T14:14:58.558721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f1a79-a0301676-d046d6ee-d7e17fb9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a048703a-2187554f-2fbf76eb-a5622737_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:58.562275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Write session: try to update token
2025-10-01T14:14:58.562296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:58.575613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:58.575634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.575637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:58.575639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:58.575648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.575652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.575655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256645544240091:8568]
2025-10-01T14:14:58.575699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:58.575703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:58.575703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:58.575706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:58.575710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.575713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:58.575848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:58.578251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId: src_id|a048703a-2187554f-2fbf76eb-a5622737_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:58.580746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:58.609189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256647921150996:7265]
2025-10-01T14:14:58.609426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2395, pipe: [1:7556256647921150996:7265]
2025-10-01T14:14:58.717250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:58.717510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.717523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.717557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921150996:7265], now have 1 active actors on pipe
2025-10-01T14:14:58.717822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:58.717822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:58.717826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:58.717870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256647921150996:7265]
2025-10-01T14:14:58.717891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2396 reason: error at write: Disconnected sessionId: src_id|a048703a-2187554f-2fbf76eb-a5622737_0
2025-10-01T14:14:58.718048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2396 sessionId: src_id|a048703a-2187554f-2fbf76eb-a5622737_0 is DEAD
2025-10-01T14:14:58.718191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:58.718200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Write session will restart in 0.008002s
2025-10-01T14:14:58.718220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Write session: Do CDS request
2025-10-01T14:14:58.718226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:58.718600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:58.727894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.727960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:58.727980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2397
2025-10-01T14:14:58.728099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.728132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:58.728141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:58.728144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:58.729201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2397 sessionId:  describe result for acl check
2025-10-01T14:14:58.729230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:58.729233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:58.729235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:58.729242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256647921151206:5308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:58.729733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256647921151206:5308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:58.732175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256647921151206:5308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:58.733447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:58.734847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:58.735043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:58.735053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:58.735063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:58.735102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:58.735141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256645544240346:8554]
2025-10-01T14:14:58.735152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256647921151206:5308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:58.735165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256647921151206:5308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:58.735168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256647921151206:5308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:58.735174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:58.735796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:58.736024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:58.736061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:58.736367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:58.736415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.736420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.736422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.736423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.736423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.736425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.736426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.736427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.736428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.736430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.736431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.736432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.736433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.736435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.736439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.736448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.736452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.736455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.736459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.736462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.736466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.736469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.736473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.736478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.736481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.736484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.736488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.736491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.736498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.736505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.736510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.736515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.736520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.736524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.736530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.736534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.736539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.736544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.736560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.736565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.736572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.736576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.736580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.736585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.736590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.736599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.736603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.736609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.736613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.736617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.736625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.736629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.736634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.736642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.736646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.736651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.736689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:58.740144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:58.740793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:58.740806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:58.740808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:58.740812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:58.740819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2396 [2:7556256645544240346:8554]
2025-10-01T14:14:58.740834Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:58.740851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:58.740860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.740863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.740865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.740879Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:58.740884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:58.740890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:58.740943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.740950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.740952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.740954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:58.740957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:58.741019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:58.741026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.741036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.741047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.741066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:58.741087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921151000:2446], now have 1 active actors on pipe
2025-10-01T14:14:58.741094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921151342:5308], now have 1 active actors on pipe
2025-10-01T14:14:58.741102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.741108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.741111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.741125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:58.741140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:58.741141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:58.741150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:58.741152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:58.741155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:58.741158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:58.741183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.741190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:58.741193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:58.741173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2396
2025-10-01T14:14:58.741204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2396
2025-10-01T14:14:58.741240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.741249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.741271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:58.741281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.741285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.741287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:58.741295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.741302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:58.741318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.741453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.741461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.741474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.741560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2397 partition: 0 MaxSeqNo: 45 sessionId: src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0
2025-10-01T14:14:58.741891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a048703a-2187554f-2fbf76eb-a5622737_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:58.744719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Write session: try to update token
2025-10-01T14:14:58.744736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:58.751996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:58.752017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.752029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.752072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:58.752078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:58.752237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:58.752383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:58.752524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:58.752673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:58.752867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:58.752906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:58.760869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId: src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:58.763564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:58.763755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.763779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.763817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:58.763902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:58.770782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:58.770802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.770805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:58.770807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:58.770819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.770823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.770826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256645544240341:8554]
2025-10-01T14:14:58.770868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:58.770872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:58.770879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.770881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:58.770884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:58.770887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:58.771006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:58.818076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256647921151354:7265]
2025-10-01T14:14:58.818300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2396, pipe: [1:7556256647921151354:7265]
2025-10-01T14:14:58.932856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:58.941476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.941509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.941665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.941724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.941788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.941867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.941915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.941926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.941990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.942047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.942106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.942171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.942217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.942225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.942289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.942350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.942424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.942487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.942533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.942540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.942605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.942668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.942729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.942791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.942835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.942842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.942903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.942964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.943025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.943088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.943136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.943144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.943207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.943274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.943334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.943394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.943443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.943452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.943517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.943576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.943638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.943705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.943749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.943758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.943829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.943887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.943951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.944016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.944066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.944073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.944136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.944196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.944261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.944320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.944362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.944371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.944427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:58.944481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:58.944543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:58.944614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:58.944657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:58.944663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:58.944723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921151354:7265], now have 1 active actors on pipe
2025-10-01T14:14:58.944963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:58.944977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:58.945000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2397 reason: error at write: Disconnected sessionId: src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0
2025-10-01T14:14:58.945169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2397 sessionId: src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0 is DEAD
2025-10-01T14:14:58.945309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:58.945318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:58.945330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Write session will restart in 0.009302s
2025-10-01T14:14:58.945355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Write session: Do CDS request
2025-10-01T14:14:58.945373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:58.945475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256647921151354:7265]
2025-10-01T14:14:58.946003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:58.959065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.959226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:58.959249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2398
2025-10-01T14:14:58.959532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:58.959582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:58.959595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:58.959599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:58.960064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2398 sessionId:  describe result for acl check
2025-10-01T14:14:58.960112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:58.960117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:58.960119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:58.960125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256647921151430:5291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:58.960915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256647921151430:5291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:58.965034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256647921151430:5291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:58.968709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256647921151430:5291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:58.968726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256647921151430:5291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:58.968731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256647921151430:5291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:58.968741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:58.979887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:58.981724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:58.981926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:58.981942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:58.981956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:58.982019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:58.982061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256645544240613:8532]
2025-10-01T14:14:58.982680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:58.983013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:58.983069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:58.983384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:58.983435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.983441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.983442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.983443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.983444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.983445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.983446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.983447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.983448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.983449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.983450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.983452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.983453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.983455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.983460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.983470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.983474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.983477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.983481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.983485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.983488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.983492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.983496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.983500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.983503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.983507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.983511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.983514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.983522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.983530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:58.983536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.983542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:58.983546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.983551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:58.983555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.983565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:58.983569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.983575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:58.983583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.983588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:58.983593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.983601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:58.983605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.983609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:58.983613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.983622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:58.983628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.983633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.983641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.983646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.983654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.983658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.983662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.983667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:58.983675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.983680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:58.983720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:58.987296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:58.988044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:58.988060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:58.988062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:58.988065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:58.988071Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2397 [2:7556256645544240613:8532]
2025-10-01T14:14:58.988087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:58.988104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:58.988107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.988110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.988112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.988129Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:58.988134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:58.988140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:58.988399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.988413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.988415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.988418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:58.988421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:58.988503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:58.988511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:58.988524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:58.988533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:58.988559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:58.988580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:58.988582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:58.988584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:58.988596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:58.988602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:58.988606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:58.988608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:58.988614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:58.988627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:58.988634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:58.988646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921151549:5291], now have 1 active actors on pipe
2025-10-01T14:14:58.988653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256647921151360:2446], now have 1 active actors on pipe
2025-10-01T14:14:58.988681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:58.988693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:58.988685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2397
2025-10-01T14:14:58.988711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:58.988712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2397
2025-10-01T14:14:58.988741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.988751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.988779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:58.988791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:58.988799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:58.988801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:58.988810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:58.988821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:58.988839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.989013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:58.989022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:58.989037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:58.989134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2398 partition: 0 MaxSeqNo: 45 sessionId: src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0
2025-10-01T14:14:58.989481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49dcd4-f84ce20f-72d9cad7-3a45be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:58.992320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Write session: try to update token
2025-10-01T14:14:58.992334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:58.999640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:58.999665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:58.999674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:58.999717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:58.999720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:58.999883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:59.000025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.000171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.000306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.000498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:59.000534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:59.009753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId: src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:59.012131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:59.012412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.012436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.012473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:59.012537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:59.017644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:59.017662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.017664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:59.017665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:59.017673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:59.017676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:59.017679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256645544240608:8532]
2025-10-01T14:14:59.017715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:59.017717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:59.017720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.017721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:59.017733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:59.017743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:59.017839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:59.045411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256652216119023:7265]
2025-10-01T14:14:59.045721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2397, pipe: [1:7556256652216119023:7265]
2025-10-01T14:14:59.157662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:59.166147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.166180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.166341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.166421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.166487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.166549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.166597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.166607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.166668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.166730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.166790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.166852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.166898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.166902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.166969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.167028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.167088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.167154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.167199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.167202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.167271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.167325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.167382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.167443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.167490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.167493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.167556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.167615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.167675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.167731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.167774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.167777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.167869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.167930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.167989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.168053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.168099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.168102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.168166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.168219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.168275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.168330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.168367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.168369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.168426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.168478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.168546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.168616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.168663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.168670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.168724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.168780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.168849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.168919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.168970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.168976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.169044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.169107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.169174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.169241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.169297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.169304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.169363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119023:7265], now have 1 active actors on pipe
2025-10-01T14:14:59.169581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256652216119023:7265]
2025-10-01T14:14:59.169622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:59.169624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:59.169627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:59.169650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2398 reason: error at write: Disconnected sessionId: src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0
2025-10-01T14:14:59.169860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2398 sessionId: src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0 is DEAD
2025-10-01T14:14:59.170224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:59.170233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Write session will restart in 0.009168s
2025-10-01T14:14:59.170258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Write session: Do CDS request
2025-10-01T14:14:59.170264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:59.170285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:59.181345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.181425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:59.181441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2399
2025-10-01T14:14:59.181686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.181728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:59.181733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:59.181736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:59.182411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2399 sessionId:  describe result for acl check
2025-10-01T14:14:59.182443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:59.182445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:59.182446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:59.182451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256652216119186:5265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:59.182944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256652216119186:5265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:59.185621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256652216119186:5265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:59.191837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256652216119186:5265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:59.191856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256652216119186:5265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:59.191860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256652216119186:5265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:59.191868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:59.197904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:59.198495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:59.198690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:59.198701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:59.198711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:59.198755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:59.198806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256649839208143:8530]
2025-10-01T14:14:59.199440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:59.199729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:59.199771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:59.200097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:59.200149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.200155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.200156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.200157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.200158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.200160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.200161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.200162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.200163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.200164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.200165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.200166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.200168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.200169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.200173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.200183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.200187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.200191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.200195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.200199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.200203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.200206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.200210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.200214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.200218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.200221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.200225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.200229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.200235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.200242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.200250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.200255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.200260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.200270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.200274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.200283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.200288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.200293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.200298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.200306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.200312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.200321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.200326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.200331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.200336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.200341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.200345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.200350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.200359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.200364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.200372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.200377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.200386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.200391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.200400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.200406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.200451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:59.204814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:59.205514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:59.205519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:59.205521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:59.205524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:59.205529Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2398 [2:7556256649839208143:8530]
2025-10-01T14:14:59.205541Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:59.205557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:59.205559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.205561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.205563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.205575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:59.205579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:59.205584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:59.205628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.205630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.205632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.205634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:59.205636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:59.205701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:59.205704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.205713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.205721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.205735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:59.205754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.205756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.205758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.205766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:59.205780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:59.205784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:59.205786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:59.205788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:59.205794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:59.205796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:59.205806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119026:2446], now have 1 active actors on pipe
2025-10-01T14:14:59.205809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119338:5265], now have 1 active actors on pipe
2025-10-01T14:14:59.205838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.205845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:59.205864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:59.206105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.206111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.206135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:59.206153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.206157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.206160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:59.206169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.206180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:59.206195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.205856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2398
2025-10-01T14:14:59.205912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2398
2025-10-01T14:14:59.206665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.206673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.206690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.206804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2399 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0
2025-10-01T14:14:59.208222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5245910-5dbca951-da23a9a7-7dfc468a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:59.211311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Write session: try to update token
2025-10-01T14:14:59.211330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:59.219850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:59.219869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.219879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.219929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:59.219932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:59.220113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:59.220268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.220412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.220546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.220778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:59.220815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:59.233590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId: src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:59.236351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:59.236572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.236593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.236632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:59.236744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:59.240219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:59.240236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.240238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:59.240240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:59.240250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.240254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.240257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256649839208138:8530]
2025-10-01T14:14:59.240303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:59.240302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:59.240309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:59.240309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.240311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:59.240313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:59.240445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:59.270471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256652216119382:7265]
2025-10-01T14:14:59.270767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2398, pipe: [1:7556256652216119382:7265]
2025-10-01T14:14:59.395371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:59.410161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.410187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.410333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.410415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.410486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.410554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.410609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.410616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.410686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.410747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.410817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.410895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.410939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.410946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.411010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.411066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.411136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.411197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.411238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.411244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.411308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.411370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.411427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.411490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.411535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.411540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.411607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.411669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.411728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.411789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.411837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.411844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.411921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.411993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.412060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.412122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.412173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.412180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.412252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.412317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.412382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.412445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.412490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.412496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.412577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.412649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.412720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.412793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.412840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.412847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.412919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.412985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.413052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.413124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.413170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.413177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.413242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:59.413301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:59.413364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:59.413425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:59.413465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:59.413472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:59.413541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119382:7265], now have 1 active actors on pipe
2025-10-01T14:14:59.413777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:59.413805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256652216119382:7265]
2025-10-01T14:14:59.413830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:59.413832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:59.413858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2399 reason: error at write: Disconnected sessionId: src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0
2025-10-01T14:14:59.414041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2399 sessionId: src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0 is DEAD
2025-10-01T14:14:59.414346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:59.414357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Write session will restart in 0.005789s
2025-10-01T14:14:59.414393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Write session: Do CDS request
2025-10-01T14:14:59.414400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:59.414684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:59.420792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.420889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:59.420907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2400
2025-10-01T14:14:59.421018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.421050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:59.421057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:59.421060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:59.421471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2400 sessionId:  describe result for acl check
2025-10-01T14:14:59.421516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:59.421523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:59.421525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:59.421532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256652216119392:5267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:59.422082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256652216119392:5267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:59.425108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256652216119392:5267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:59.428209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256652216119392:5267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:59.428230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256652216119392:5267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:59.428233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256652216119392:5267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:59.428241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:59.442892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:59.444917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:59.445094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:59.445103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:59.445114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:59.445152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:59.445182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256649839208382:8527]
2025-10-01T14:14:59.445717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:59.445981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:59.446015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:59.446268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:59.446311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.446317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.446318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.446319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.446320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.446321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.446322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.446323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.446324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.446325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.446326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.446327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.446328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.446329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.446334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.446342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.446346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.446349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.446352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.446355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.446367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.446384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.446387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.446390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.446393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.446396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.446399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.446402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.446409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.446414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.446419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.446424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.446428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.446432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.446435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.446439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.446443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.446447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.446450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.446454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.446458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.446462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.446465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.446469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.446475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.446478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.446482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.446486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.446490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.446494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.446498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.446501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.446509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.446513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.446516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.446520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.446553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:59.450350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:59.451041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:59.451053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:59.451055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:59.451059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:59.451066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2399 [2:7556256649839208382:8527]
2025-10-01T14:14:59.451081Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:59.451097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:59.451107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.451110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.451112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.451127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:59.451136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:59.451142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:59.451197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.451203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.451205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.451209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:59.451211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:59.451276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:59.451284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.451295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.451308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.451324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:59.451343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.451349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.451351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.451365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:59.451378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:59.451383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119454:5267], now have 1 active actors on pipe
2025-10-01T14:14:59.451386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:59.451386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119385:2446], now have 1 active actors on pipe
2025-10-01T14:14:59.451389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:59.451393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:59.451405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:59.451409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:59.451443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.451455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:59.451467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:59.452380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2399
2025-10-01T14:14:59.452447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2399
2025-10-01T14:14:59.452672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.452681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.452706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:59.452713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.452722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.452724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:59.452734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.452743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:59.452761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.456211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.456221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.456244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.457662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2400 partition: 0 MaxSeqNo: 45 sessionId: src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0
2025-10-01T14:14:59.458033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62e1f5-142de55a-b79479d3-ccfad588_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:59.461512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Write session: try to update token
2025-10-01T14:14:59.461530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:59.463396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:59.463410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.463418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.463457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:59.463458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:59.463613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:59.463743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.463866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.463999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:59.464183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:59.464220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:59.484080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:59.484099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.484103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:59.484105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:59.484119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.484127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.484137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256649839208377:8527]
2025-10-01T14:14:59.484195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:59.484210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:59.484212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:59.484213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:59.484222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.484225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:59.484473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:59.485316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId: src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:59.488495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:59.513907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256652216119743:7265]
2025-10-01T14:14:59.514138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2399, pipe: [1:7556256652216119743:7265]
2025-10-01T14:14:59.628226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:59.628668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.628680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.628699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119743:7265], now have 1 active actors on pipe
2025-10-01T14:14:59.628849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:59.628896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256652216119743:7265]
2025-10-01T14:14:59.628898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:59.628902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:59.628929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:59.628974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2400 reason: error at write: Disconnected sessionId: src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0
2025-10-01T14:14:59.629137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2400 sessionId: src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0 is DEAD
2025-10-01T14:14:59.629278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:59.629286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Write session will restart in 0.009176s
2025-10-01T14:14:59.629315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Write session: Do CDS request
2025-10-01T14:14:59.629321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:59.639940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.642524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:59.642542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2401
2025-10-01T14:14:59.642684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.642723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:59.642734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:59.642737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:59.643683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2401 sessionId:  describe result for acl check
2025-10-01T14:14:59.643720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:59.643722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:59.643723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:59.643728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256652216120052:5220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:59.644237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256652216120052:5220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:59.646353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256652216120052:5220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:59.646676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:59.648570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:59.648764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:59.648775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:59.648786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:59.648834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:59.648876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256649839208636:8520]
2025-10-01T14:14:59.649319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256652216120052:5220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:59.649331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256652216120052:5220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:59.649334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256652216120052:5220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:59.649339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:59.649467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:59.649681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:59.649719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:59.650007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:59.650064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.650070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.650071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.650072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.650073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.650074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.650075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.650077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.650078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.650079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.650079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.650081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.650082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.650083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.650087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.650096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.650100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.650105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.650108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.650112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.650116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.650120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.650124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.650140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.650144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.650147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.650151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.650154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.650161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.650168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.650174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.650184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.650188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.650198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.650203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.650208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.650214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.650224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.650228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.650233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.650242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.650248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.650256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.650262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.650271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.650277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.650285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.650291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.650300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.650306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.650314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.650319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.650328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.650332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.650337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.650342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.650423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:59.654744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:59.655409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:59.655425Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:59.655429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:59.655432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:59.655439Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2400 [2:7556256649839208636:8520]
2025-10-01T14:14:59.655458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:59.655480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:59.655487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.655490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.655492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.655509Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:59.655519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:59.655525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:59.655586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.655594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.655596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.655599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:59.655603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:59.655673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:59.655680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.655693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.655712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.655734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:59.655757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216120122:5220], now have 1 active actors on pipe
2025-10-01T14:14:59.655765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216119778:2446], now have 1 active actors on pipe
2025-10-01T14:14:59.655772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.655779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.655782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.655795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:59.655812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:59.655820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2400
2025-10-01T14:14:59.655815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:59.655820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2400
2025-10-01T14:14:59.655818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:59.655820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:59.655833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:59.655837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:59.655871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.655878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:59.655883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:59.655898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.655903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.655956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:59.655967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.655972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.655974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:59.655984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.655997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:59.656121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.656242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.656251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.656266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.656385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2401 partition: 0 MaxSeqNo: 45 sessionId: src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0
2025-10-01T14:14:59.656760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaa7376-7245ea12-340ab8b6-f51b5430_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:59.659929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Write session: try to update token
2025-10-01T14:14:59.659947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:59.674551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId: src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:59.679556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:59.679577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.679580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:59.679583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:59.679595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.679600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.679605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256649839208631:8520]
2025-10-01T14:14:59.679660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:59.679666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:59.679669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.679672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:59.679672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:59.679675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:59.679800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:59.679817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:59.728942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256652216120134:7265]
2025-10-01T14:14:59.729253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2400, pipe: [1:7556256652216120134:7265]
2025-10-01T14:14:59.835304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:59.835863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.835876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.835910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216120134:7265], now have 1 active actors on pipe
2025-10-01T14:14:59.836079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:59.836178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:59.836188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256652216120134:7265]
2025-10-01T14:14:59.836194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:59.836205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:59.836226Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:14:59.836242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2401 reason: error at write: Disconnected sessionId: src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0
2025-10-01T14:14:59.836307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2401 sessionId: src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0 is DEAD
2025-10-01T14:14:59.836322Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 is DEAD
2025-10-01T14:14:59.836422Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256553431843834:7256] disconnected; active server actors: 1
2025-10-01T14:14:59.836430Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256553431843834:7256] client user disconnected session shared/user_1_24_6388546463162030126_v1
2025-10-01T14:14:59.836565Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:14:59.836584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:59.836594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Write session will restart in 0.008856s
2025-10-01T14:14:59.836620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Write session: Do CDS request
2025-10-01T14:14:59.836629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:59.836676Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:14:59.836680Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:14:59.836689Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.008510s
2025-10-01T14:14:59.845731Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:14:59.845883Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:14:59.845899Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 25
2025-10-01T14:14:59.846079Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 25 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:14:59.846148Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:14:59.846229Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 auth for : user
2025-10-01T14:14:59.846459Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 Handle describe topics response
2025-10-01T14:14:59.846489Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 auth is DEAD
2025-10-01T14:14:59.846499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:14:59.846739Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:14:59.846799Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_25_6015796456480817416_v1
2025-10-01T14:14:59.846879Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256652216120353:5210] connected; active server actors: 1
2025-10-01T14:14:59.846898Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256652216120353:5210] session shared/user_1_25_6015796456480817416_v1
2025-10-01T14:14:59.846907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:14:59.846924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:14:59.846931Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_25_6015796456480817416_v1" (Sender=[1:7556256652216120320:5210], Pipe=[1:7556256652216120353:5210], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:14:59.846939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:14:59.846951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:14:59.846965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_25_6015796456480817416_v1" (Sender=[1:7556256652216120320:5210], Pipe=[1:7556256652216120353:5210], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:14:59.846979Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_25_6015796456480817416_v1" sender [1:7556256652216120320:5210] lock partition 0 for ReadingSession "shared/user_1_25_6015796456480817416_v1" (Sender=[1:7556256652216120320:5210], Pipe=[1:7556256652216120353:5210], Partitions=[], ActiveFamilyCount=1) generation 1 step 25
2025-10-01T14:14:59.846994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:14:59.847002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000044s
2025-10-01T14:14:59.847212Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 25 Session: "shared/user_1_25_6015796456480817416_v1" ClientId: "user" PipeClient { RawX1: 7556256652216120353 RawX2: 4503603922343002 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:14:59.847235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:14:59.848402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.848464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:59.848478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2402
2025-10-01T14:14:59.848570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:59.848595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:59.848615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:59.848622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:59.848959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2402 sessionId:  describe result for acl check
2025-10-01T14:14:59.848997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:59.849006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:59.849008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:59.849014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256652216120441:5190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:59.849548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256652216120441:5190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:59.851037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:59.851523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256652216120441:5190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:59.852590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:59.852772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:59.852784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:59.852797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:59.852853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:59.852895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256649839208876:8513]
2025-10-01T14:14:59.853496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:59.853759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:59.853802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:59.853876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256652216120441:5190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:59.853889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256652216120441:5190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:59.853892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256652216120441:5190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:59.853899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:59.854103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:59.854156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.854161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.854162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.854163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.854164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.854165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.854167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.854168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.854169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.854170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.854171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.854172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.854173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.854174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.854179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.854189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.854193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.854197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.854201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.854205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.854209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.854217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.854220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.854226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.854230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.854237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.854241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.854248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.854255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.854266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:59.854276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.854285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:59.854294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.854303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:59.854308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.854313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:59.854319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.854329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:59.854334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.854342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:59.854350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.854360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:59.854385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.854391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:59.854399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.854406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:59.854414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.854423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.854431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.854439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.854447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.854452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.854460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.854469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:59.854476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.854482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:59.854520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:59.858283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:59.859371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:59.859388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:59.859391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:59.859395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:59.859401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2401 [2:7556256649839208876:8513]
2025-10-01T14:14:59.859415Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:59.859437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:59.859444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.859447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.859450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.859467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:59.859479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:59.859484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:59.859540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.859548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.859550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.859553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:59.859556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:59.859622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:59.859630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.859643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:59.859658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:59.859674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:59.859699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216120378:5192], now have 1 active actors on pipe
2025-10-01T14:14:59.859706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216120494:5190], now have 1 active actors on pipe
2025-10-01T14:14:59.859709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256652216120137:2446], now have 1 active actors on pipe
2025-10-01T14:14:59.859715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.859718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.859720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.859734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:59.859745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:59.859751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:59.859753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:59.859756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:59.859764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:59.859767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:59.859770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2401
2025-10-01T14:14:59.859801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.859811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:59.859812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:59.859833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2401, pipe: [1:7556256652216120378:5192]
2025-10-01T14:14:59.859855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.859866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.859878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_25_6015796456480817416_v1 on pipe: [1:7556256652216120378:5192]
2025-10-01T14:14:59.859856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2401
2025-10-01T14:14:59.859910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.859917Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_25_6015796456480817416_v1:1 with generation 2401
2025-10-01T14:14:59.859917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.859929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.859936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.859942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:59.859960Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_25_6015796456480817416_v1
2025-10-01T14:14:59.859968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.860000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:59.860009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:14:59.860013Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:14:59.864269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:14:59.864302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:14:59.864310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:59.864316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:59.864318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:59.864330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:59.864342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:59.864355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:14:59.864372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:14:59.864390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.864490Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328099859 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:14:59.864511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:14:59.864539Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 sending to client partition status
2025-10-01T14:14:59.864572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:59.864588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:59.864606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:59.864683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2402 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0
2025-10-01T14:14:59.865014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d6d9c1-b8765aa8-88dcd807-df8b6b56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:59.867685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Write session: try to update token
2025-10-01T14:14:59.867703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:59.879959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:59.879975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:59.879977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:59.879979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:59.879990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.879996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.880000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256649839208871:8513]
2025-10-01T14:14:59.880047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:59.880051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:59.880058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:59.880058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:59.880060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:59.880062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:59.880196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:59.880328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId: src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:59.882832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:00.024052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:00.024319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.024334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.024620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_25_6015796456480817416_v1
2025-10-01T14:15:00.024640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:00.024611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256652216120378:5192]
2025-10-01T14:15:00.024641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:00.024665Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_25_6015796456480817416_v1
2025-10-01T14:15:00.024644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:00.024646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:00.024697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2402 reason: error at write: Disconnected sessionId: src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0
2025-10-01T14:15:00.024845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2402 sessionId: src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0 is DEAD
2025-10-01T14:15:00.025010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:00.025024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Write session will restart in 0.005637s
2025-10-01T14:15:00.025050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Write session: Do CDS request
2025-10-01T14:15:00.025056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:00.031860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.031969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:00.031986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2403
2025-10-01T14:15:00.032136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.032177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:00.032188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:00.032192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:00.032606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2403 sessionId:  describe result for acl check
2025-10-01T14:15:00.032639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:00.032644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:00.032646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:00.032650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256656511087883:5184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:00.033167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256656511087883:5184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:00.036741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256656511087883:5184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:00.039671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256656511087883:5184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:00.039689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256656511087883:5184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:00.039693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256656511087883:5184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:00.039701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:00.040935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:00.042577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:00.042765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:00.042775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:00.042786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:00.042829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:00.042859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256654134176442:8497]
2025-10-01T14:15:00.043248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:00.043509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:00.043538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:00.043737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:00.043771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.043775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.043776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.043777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.043778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.043779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.043779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.043780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.043781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.043781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.043782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.043783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.043783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.043784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.043787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.043793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.043796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.043798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.043800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.043802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.043804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.043806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.043808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.043811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.043813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.043815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.043817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.043819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.043824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.043829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.043833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.043836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.043838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.043841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.043844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.043846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.043849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.043852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.043855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.043858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.043860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.043871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.043873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.043876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.043881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.043884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.043886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.043890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.043893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.043896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.043899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.043901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.043905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.043910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.043914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.043919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.043950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:00.047775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:00.048528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:00.048539Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:00.048541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:00.048543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:00.048563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2402 [2:7556256654134176442:8497]
2025-10-01T14:15:00.048575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:00.048589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:00.048591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.048593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.048594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.048607Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:00.048611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:00.048617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:00.048658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.048663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.048665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.048668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:00.048669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:00.048722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:00.048728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.048736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.048742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.048752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:00.048768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.048773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.048774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.048783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:00.048789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:00.048793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511087816:2446], now have 1 active actors on pipe
2025-10-01T14:15:00.048797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:00.048799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:00.048800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:00.048809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:00.048811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:00.048815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088162:5184], now have 1 active actors on pipe
2025-10-01T14:15:00.048841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.048851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:00.048842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2402
2025-10-01T14:15:00.048880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2402
2025-10-01T14:15:00.048881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:00.048920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.048929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.048946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:00.048955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.048958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.048960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:00.048967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.048977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:00.048989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.049110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.049112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.049121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.049186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2403 partition: 0 MaxSeqNo: 45 sessionId: src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0
2025-10-01T14:15:00.049503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9be0be0-c599b58c-f50450b0-3fc58eaf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:00.052318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Write session: try to update token
2025-10-01T14:15:00.052337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:00.067213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:00.067229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.067238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.067285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:00.067291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:00.067473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:00.067613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.067752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.067886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.068060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:00.068091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:00.069109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId: src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:00.072165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:00.072383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.072404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.072453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:00.072534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:00.082231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:00.082249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.082252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:00.082254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:00.082265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.082269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.082273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256654134176437:8497]
2025-10-01T14:15:00.082314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:00.082325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:00.082326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:00.082330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:00.082333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.082335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:00.082509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:00.126482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256656511088176:5192]
2025-10-01T14:15:00.130827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2402, pipe: [1:7556256656511088176:5192]
2025-10-01T14:15:00.240257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:00.249130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.249164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.249344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.249411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.249483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.249551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.249602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.249612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.249705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.249778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.249845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.249913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.249964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.249972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.250054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.250124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.250192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.250259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.250308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.250317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.250427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.250500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.250569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.250643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.250692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.250700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.250773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.250842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.250911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.250981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.251031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.251038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.251112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.251183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.251254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.251331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.251382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.251389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.251467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.251534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.251608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.251679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.251729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.251736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.251805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.251873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.251942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.252027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.252078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.252085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.252172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.252246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.252324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.252396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.252444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.252456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.252525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.252602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.252667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.252733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.252773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.252775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.252841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088176:5192], now have 1 active actors on pipe
2025-10-01T14:15:00.254168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256656511088176:5192]
2025-10-01T14:15:00.254201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:00.254198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:00.254301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:00.254353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0
2025-10-01T14:15:00.254608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2403 sessionId: src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0 is DEAD
2025-10-01T14:15:00.254742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:00.254753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Write session will restart in 0.008363s
2025-10-01T14:15:00.254788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Write session: Do CDS request
2025-10-01T14:15:00.254794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:00.264072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.264126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:00.264144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2404
2025-10-01T14:15:00.264726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.264776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:00.264788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:00.264793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:00.265487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2404 sessionId:  describe result for acl check
2025-10-01T14:15:00.265526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:00.265528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:00.265530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:00.265535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256656511088268:5166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:00.266072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256656511088268:5166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:00.268729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256656511088268:5166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:00.271644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256656511088268:5166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:00.271692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256656511088268:5166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:00.271706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256656511088268:5166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:00.271730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:00.275197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:00.277242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:00.277445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:00.277448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:00.277456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:00.277491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:00.277518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256654134176683:8499]
2025-10-01T14:15:00.277902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:00.278210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:00.278232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:00.278455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:00.278498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.278502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.278503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.278504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.278505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.278505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.278506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.278507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.278508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.278509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.278509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.278510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.278511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.278511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.278514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.278520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.278522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.278524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.278526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.278528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.278531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.278533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.278535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.278537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.278540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.278542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.278544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.278546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.278552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.278557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.278561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.278564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.278567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.278570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.278573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.278577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.278580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.278582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.278585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.278588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.278591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.278594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.278596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.278599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.278602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.278605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.278607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.278610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.278613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.278616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.278618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.278621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.278624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.278627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.278629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.278632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.278654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:00.282282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:00.283478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:00.283494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:00.283496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:00.283500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:00.283508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2403 [2:7556256654134176683:8499]
2025-10-01T14:15:00.283525Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:00.283543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:00.283546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.283550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.283552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.283567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:00.283574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:00.283580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:00.283639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.283641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.283644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.283647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:00.283650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:00.283720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:00.283728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.283739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.283751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.283771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:00.283792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088499:5166], now have 1 active actors on pipe
2025-10-01T14:15:00.283799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088181:2446], now have 1 active actors on pipe
2025-10-01T14:15:00.283806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.283809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.283811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.283824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:00.283841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:00.283859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:00.283866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:00.283900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.283900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:00.283882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2403
2025-10-01T14:15:00.283903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:00.283906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:00.283895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2403
2025-10-01T14:15:00.283909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:00.283912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:00.284054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.284065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.284095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:00.284107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.284111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.284117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:00.284126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.284135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:00.284151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.284300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.284308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.284321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.284485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2404 partition: 0 MaxSeqNo: 45 sessionId: src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0
2025-10-01T14:15:00.284874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a8f6b4-50e71451-9f2a887-8f015da0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:00.288042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Write session: try to update token
2025-10-01T14:15:00.288061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:00.304773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId: src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:00.307291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:00.308208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.308236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.308257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:00.308260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.308263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:00.308265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:00.308283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.308289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.308293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256654134176678:8499]
2025-10-01T14:15:00.308355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:00.308364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:00.308369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.308371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:00.308372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:00.308376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:00.308521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:00.354105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256656511088554:5192]
2025-10-01T14:15:00.354414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2403, pipe: [1:7556256656511088554:5192]
2025-10-01T14:15:00.447648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:00.447951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:00.448032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088554:5192], now have 1 active actors on pipe
2025-10-01T14:15:00.448124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:00.448283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256656511088554:5192]
2025-10-01T14:15:00.448313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:00.459694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:00.459711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:00.459736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2404 reason: error at write: Disconnected sessionId: src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0
2025-10-01T14:15:00.459894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2404 sessionId: src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0 is DEAD
2025-10-01T14:15:00.460061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:00.460073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Write session will restart in 0.009394s
2025-10-01T14:15:00.460106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Write session: Do CDS request
2025-10-01T14:15:00.460115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:00.470816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.470905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:00.470924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2405
2025-10-01T14:15:00.471064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.471098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:00.471109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:00.471113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:00.471543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2405 sessionId:  describe result for acl check
2025-10-01T14:15:00.471582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:00.471592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:00.471594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:00.471599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256656511088810:5155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:00.472143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256656511088810:5155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:00.475409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256656511088810:5155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:00.475506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:00.477813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:00.478073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:00.478089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:00.478111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:00.478178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256656511088810:5155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:00.478190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256656511088810:5155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:00.478219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:00.478193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256656511088810:5155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:00.478199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:00.478256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256654134176924:8491]
2025-10-01T14:15:00.478662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:00.479018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:00.479050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:00.479244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:00.479289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.479295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.479296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.479296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.479297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.479298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.479299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.479299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.479300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.479301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.479302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.479303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.479303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.479304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.479308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.479314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.479316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.479318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.479320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.479322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.479324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.479327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.479329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.479331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.479333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.479336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.479338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.479340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.479345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.479350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.479362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.479365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.479368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.479371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.479374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.479377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.479380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.479383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.479385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.479389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.479392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.479395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.479398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.479401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.479404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.479412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.479415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.479418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.479421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.479424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.479426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.479430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.479433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.479436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.479439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.479447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.479467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:00.483328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:00.484078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:00.484090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:00.484092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:00.484097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:00.484104Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2404 [2:7556256654134176924:8491]
2025-10-01T14:15:00.484123Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:00.484139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:00.484146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.484151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.484153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.484165Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:00.484173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:00.484178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:00.484223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.484230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.484231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.484234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:00.484236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:00.484289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:00.484294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.484301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.484307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.484319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:00.484340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088908:5155], now have 1 active actors on pipe
2025-10-01T14:15:00.484350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.484352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.484354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.484366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:00.484376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088556:2446], now have 1 active actors on pipe
2025-10-01T14:15:00.484376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:00.484379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:00.484381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:00.484382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:00.484390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:00.484392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:00.484418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.484436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:00.484452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:00.484423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2404
2025-10-01T14:15:00.484428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2404
2025-10-01T14:15:00.484536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.484543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.484572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:00.484582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.484590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.484592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:00.484602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.484616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:00.484631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.484860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.484872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.484894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.484992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2405 partition: 0 MaxSeqNo: 45 sessionId: src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0
2025-10-01T14:15:00.485317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa22545-a2331fd3-37b035e9-9eaa88ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:00.488193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Write session: try to update token
2025-10-01T14:15:00.488208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:00.500985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:00.501000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.501009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.501056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:00.501062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:00.501210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:00.501349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.501482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.501615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.501872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:00.501914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:00.502603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId: src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:00.505293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:00.505685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.505706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.505736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:00.505825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:00.515197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:00.515211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.515213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:00.515215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:00.515226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.515231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.515235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256654134176919:8491]
2025-10-01T14:15:00.515288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:00.515288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:00.515295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:00.515296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.515298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:00.515299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:00.515422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:00.548655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256656511088925:5192]
2025-10-01T14:15:00.548968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2404, pipe: [1:7556256656511088925:5192]
2025-10-01T14:15:00.661917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:00.671044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.671082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.671261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.671343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.671408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.671473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.671775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.671782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.671857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.671920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.671981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.672049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.672094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.672098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.672178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.672250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.672318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.672390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.672439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.672442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.672527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.672609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.672671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.672740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.672784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.672787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.672864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.672935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.673002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.673071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.673120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.673123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.673201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.673268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.673337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.673406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.673451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.673457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.673537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.673598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.673671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.673743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.673789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.673793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.673867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.673929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.673994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.674064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.674108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.674111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.674190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.674255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.674328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.674414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.674467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.674470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.674544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.674613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.674680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.674755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.674809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.674812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.675249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256656511088925:5192]
2025-10-01T14:15:00.675283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:00.675290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:00.675294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:00.675322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2405 reason: error at write: Disconnected sessionId: src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0
2025-10-01T14:15:00.674905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088925:5192], now have 1 active actors on pipe
2025-10-01T14:15:00.675527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2405 sessionId: src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0 is DEAD
2025-10-01T14:15:00.675692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:00.675704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Write session will restart in 0.005936s
2025-10-01T14:15:00.675730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Write session: Do CDS request
2025-10-01T14:15:00.675736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:00.676002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:00.686824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.686933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:00.686953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2406
2025-10-01T14:15:00.690293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.690346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:00.690355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:00.690359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:00.690998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2406 sessionId:  describe result for acl check
2025-10-01T14:15:00.691034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:00.691036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:00.691038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:00.691044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256656511089175:5121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:00.691596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256656511089175:5121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:00.693290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256656511089175:5121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:00.696748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256656511089175:5121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:00.696766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256656511089175:5121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:00.696770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256656511089175:5121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:00.696779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:00.697181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:00.698830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:00.698995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:00.699007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:00.699019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:00.699065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:00.699103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256654134177185:8486]
2025-10-01T14:15:00.699507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:00.699992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:00.700036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:00.700326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:00.700383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.700384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.700385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.700386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.700387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.700388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.700389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.700390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.700392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.700393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.700394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.700395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.700397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.700398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.700403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.700410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.700412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.700414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.700416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.700418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.700420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.700422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.700424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.700426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.700428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.700430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.700432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.700434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.700440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.700444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.700448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.700451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.700454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.700457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.700460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.700463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.700467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.700470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.700472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.700475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.700478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.700481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.700483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.700486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.700488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.700492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.700494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.700497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.700499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.700502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.700506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.700509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.700511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.700514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.700516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.700519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.700539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:00.704041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:00.704926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:00.704945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:00.704947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:00.704950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:00.704955Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2405 [2:7556256654134177185:8486]
2025-10-01T14:15:00.704965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:00.704978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:00.704980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.704982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.704984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.704996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:00.705000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:00.705004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:00.705043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.705044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.705046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.705049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:00.705051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:00.705101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:00.705105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.705112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.705234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2405
2025-10-01T14:15:00.705260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2405
2025-10-01T14:15:00.705519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2406 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0
2025-10-01T14:15:00.705835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b57c75-1fbbc049-6c899886-46b7bbdb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:00.705118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.705137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:00.705154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511089305:5121], now have 1 active actors on pipe
2025-10-01T14:15:00.705157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511088957:2446], now have 1 active actors on pipe
2025-10-01T14:15:00.705162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.705163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.705165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.705174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:00.705185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:00.705186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:00.705187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:00.705189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:00.705193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:00.705195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:00.705217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.705221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:00.705237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:00.705274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.705279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.705303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:00.705308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.705312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.705313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:00.705323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.705332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:00.705350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.705449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.705452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.705465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.708700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Write session: try to update token
2025-10-01T14:15:00.708717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:00.716188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:00.716209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.716220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.716260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:00.716267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:00.716442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:00.716602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.716742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.716891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.717097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:00.717141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:00.723444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId: src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:00.726333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:00.726564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.726587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.726628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:00.726715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:00.734622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:00.734642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.734645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:00.734648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:00.734659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.734663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.734667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256654134177180:8486]
2025-10-01T14:15:00.734702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:00.734706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:00.734710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:00.734711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:00.734719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.734721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:00.734851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:00.775475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256656511089317:5192]
2025-10-01T14:15:00.775730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2405, pipe: [1:7556256656511089317:5192]
2025-10-01T14:15:00.875820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:00.883458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.883481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.883625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.883691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.883759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.883813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.883853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.883860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.883919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.883982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.884040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.884094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.884136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.884142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.884204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.884262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.884321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.884381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.884421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.884430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.884500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.884581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.884642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.884701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.884747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.884754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.884815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.884873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.884932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.884997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.885046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.885057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.885136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.885190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.885250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.885315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.885371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.885374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.885447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.885507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.885566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.885632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.885679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.885684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.885742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.885796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.885854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.885911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.885955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.885962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.886031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.886100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.886166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.886227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.886270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.886275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.886341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:00.886426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:00.886486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:00.886553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:00.886598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:00.886606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:00.886669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511089317:5192], now have 1 active actors on pipe
2025-10-01T14:15:00.886917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:00.887340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:00.887350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Write session will restart in 0.007293s
2025-10-01T14:15:00.887379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Write session: Do CDS request
2025-10-01T14:15:00.887385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:00.886976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:00.886996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:00.887028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2406 reason: error at write: Disconnected sessionId: src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0
2025-10-01T14:15:00.887217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2406 sessionId: src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0 is DEAD
2025-10-01T14:15:00.887395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256656511089317:5192]
2025-10-01T14:15:00.887832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:00.895923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.896013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:00.896317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2407
2025-10-01T14:15:00.896532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:00.896599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:00.896615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:00.896619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:00.897031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2407 sessionId:  describe result for acl check
2025-10-01T14:15:00.897068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:00.897075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:00.897077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:00.897083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256656511089436:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:00.897637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256656511089436:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:00.900821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256656511089436:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:00.903674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256656511089436:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:00.903692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256656511089436:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:00.903696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256656511089436:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:00.903703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:00.904677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:00.906599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:00.906849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:00.906862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:00.906875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:00.906961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:00.907017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256654134177429:8476]
2025-10-01T14:15:00.907682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:00.908007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:00.908061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:00.908383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:00.908461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.908467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.908469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.908470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.908471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.908473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.908474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.908475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.908476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.908478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.908479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.908480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.908482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.908483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.908489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.908498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.908502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.908505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.908509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.908514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.908519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.908523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.908526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.908531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.908535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.908538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.908543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.908562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.908571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.908579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:00.908590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.908595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:00.908599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.908604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:00.908606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.908609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:00.908612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.908615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:00.908617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.908620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:00.908623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.908627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:00.908630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.908633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:00.908636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.908640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:00.908642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.908646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.908650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.908653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.908656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.908659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.908662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.908664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:00.908667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.908670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:00.908691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:00.912873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:00.913881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:00.913896Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:00.913898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:00.913901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:00.913908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2406 [2:7556256654134177429:8476]
2025-10-01T14:15:00.913924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:00.913946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:00.913954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.913958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.913960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.913979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:00.913988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:00.913994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:00.914053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.914059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.914061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.914065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:00.914067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:00.914137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:00.914144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.914156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:00.914170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:00.914188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:00.914207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511089671:5115], now have 1 active actors on pipe
2025-10-01T14:15:00.914214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511089320:2446], now have 1 active actors on pipe
2025-10-01T14:15:00.914222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.914225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.914227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.914240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:00.914252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:00.914258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:00.914260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:00.914262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:00.914272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:00.914275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:00.914321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.914331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:00.914307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2406
2025-10-01T14:15:00.914358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:00.914443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2406
2025-10-01T14:15:00.914507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.914522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.914553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8847c4d-374b515f-2e189540-9a90677c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:00.914567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:00.914576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:00.914582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:00.914594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:00.914606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:00.914627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.914810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.914818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.914833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:00.914932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2407 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8847c4d-374b515f-2e189540-9a90677c_0
2025-10-01T14:15:00.915447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1fa650-64b92a07-988ea9bd-f3cba33a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8847c4d-374b515f-2e189540-9a90677c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:00.918297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Write session: try to update token
2025-10-01T14:15:00.918311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:00.925056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:00.925077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.925091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.925143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:00.925153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:00.925342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:00.925499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.925654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.925805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:00.926052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:00.926101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:00.933156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId: src_id|d8847c4d-374b515f-2e189540-9a90677c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:00.936012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:00.936207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:00.936227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:00.936262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:00.936350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:00.944390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:00.944411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:00.944414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:00.944415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:00.944425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.944430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.944433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256654134177424:8476]
2025-10-01T14:15:00.944481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:00.944487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:00.944494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:00.944495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:00.944496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:00.944497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:00.944638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:00.987427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256656511089695:5192]
2025-10-01T14:15:00.987960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2406, pipe: [1:7556256656511089695:5192]
2025-10-01T14:15:01.087778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:01.099754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.099787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.099965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.100179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.100400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.100454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.100494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.100504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.100574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.100630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.100685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.100737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.100777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.100782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.100843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.100897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.100954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.101014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.101055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.101060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.101130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.101196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.101251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.101310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.101351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.101360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.101420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.101476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.101534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.101747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.101787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.101793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.101988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.102047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.102112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.102173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.102212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.102218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.102276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.102328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.102400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.102578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.102618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.102624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.102797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.102852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.102904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.102957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.103056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.103061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.103125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.103185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.103254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.103309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.103352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.103359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.103422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.103664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.103896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.103948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.104057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.104063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.104122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256656511089695:5192], now have 1 active actors on pipe
2025-10-01T14:15:01.104375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:01.104382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256656511089695:5192]
2025-10-01T14:15:01.104408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:01.104411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:01.104563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2407 reason: error at write: Disconnected sessionId: src_id|d8847c4d-374b515f-2e189540-9a90677c_0
2025-10-01T14:15:01.104755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2407 sessionId: src_id|d8847c4d-374b515f-2e189540-9a90677c_0 is DEAD
2025-10-01T14:15:01.104908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:01.104917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Write session will restart in 0.005242s
2025-10-01T14:15:01.104937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Write session: Do CDS request
2025-10-01T14:15:01.104942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:01.105162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:01.110894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.110972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:01.110988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2408
2025-10-01T14:15:01.111154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.111185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:01.111194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:01.111198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:01.111592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2408 sessionId:  describe result for acl check
2025-10-01T14:15:01.111647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:01.111653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:01.111654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:01.111659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256660806057037:5099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:01.112161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256660806057037:5099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:01.114552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256660806057037:5099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:01.117530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256660806057037:5099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:01.117553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256660806057037:5099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:01.117556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256660806057037:5099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:01.117565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:01.120698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:01.122667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:01.122956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:01.122969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:01.122982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:01.123035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:01.123078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256658429144997:8464]
2025-10-01T14:15:01.123677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:01.123973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:01.124016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:01.124315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:01.124373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.124379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.124380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.124381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.124382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.124384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.124385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.124386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.124387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.124389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.124390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.124391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.124392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.124393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.124398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.124409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.124413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.124417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.124422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.124427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.124435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.124440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.124443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.124446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.124450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.124455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.124459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.124463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.124476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.124487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.124496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.124503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.124507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.124511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.124515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.124520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.124524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.124532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.124538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.124556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.124563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.124567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.124576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.124580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.124584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.124588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.124592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.124596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.124601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.124607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.124613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.124618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.124624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.124629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.124633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.124638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.124683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:01.128312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:01.128959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:01.128978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:01.128980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:01.128984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:01.128990Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2407 [2:7556256658429144997:8464]
2025-10-01T14:15:01.129006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:01.129028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:01.129035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.129038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.129041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.129055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:01.129062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:01.129073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:01.129132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.129139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.129141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.129144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:01.129146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:01.129206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:01.129213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.129225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.129240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.129259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:01.129283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806056997:2446], now have 1 active actors on pipe
2025-10-01T14:15:01.129287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057314:5099], now have 1 active actors on pipe
2025-10-01T14:15:01.129294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.129297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.129301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.129314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:01.129327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:01.129335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:01.129338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:01.129340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:01.129343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:01.129350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:01.129342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2407
2025-10-01T14:15:01.129380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.129390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:01.129390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2407
2025-10-01T14:15:01.129404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:01.129427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.129436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.129463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:01.129473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.129477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.129480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:01.129488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.129496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:01.129513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.129645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.129653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.129667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.129744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2408 partition: 0 MaxSeqNo: 45 sessionId: src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0
2025-10-01T14:15:01.130136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8847c4d-374b515f-2e189540-9a90677c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:01.132904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Write session: try to update token
2025-10-01T14:15:01.132918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:01.149588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId: src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:01.149825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:01.149842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:01.149843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:01.149845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:01.149853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.149856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.149859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256658429144992:8464]
2025-10-01T14:15:01.149912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:01.149922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.149923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:01.150046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:01.150090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:01.150100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:01.150103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:01.152045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:01.204584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256660806057363:5192]
2025-10-01T14:15:01.204946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2407, pipe: [1:7556256660806057363:5192]
2025-10-01T14:15:01.300540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:01.300845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.300863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.300911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057363:5192], now have 1 active actors on pipe
2025-10-01T14:15:01.302620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:01.302644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:01.302647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:01.302654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:01.302697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256660806057363:5192]
2025-10-01T14:15:01.302723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2408 reason: error at write: Disconnected sessionId: src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0
2025-10-01T14:15:01.302907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2408 sessionId: src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0 is DEAD
2025-10-01T14:15:01.303075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:01.303083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Write session will restart in 0.005192s
2025-10-01T14:15:01.303111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Write session: Do CDS request
2025-10-01T14:15:01.303128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:01.309913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.310004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:01.310027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2409
2025-10-01T14:15:01.310214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.310269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:01.310279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:01.310283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:01.310729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2409 sessionId:  describe result for acl check
2025-10-01T14:15:01.310769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:01.310776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:01.310778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:01.310783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256660806057384:5086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:01.311319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256660806057384:5086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:01.313805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256660806057384:5086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:01.319869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256660806057384:5086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:01.319894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256660806057384:5086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:01.319897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256660806057384:5086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:01.319906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:01.325051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:01.327743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:01.327939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:01.327947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:01.327954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:01.327991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:01.328024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256658429145245:8458]
2025-10-01T14:15:01.328621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:01.329086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:01.329133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:01.329464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:01.329521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.329528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.329529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.329530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.329531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.329533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.329535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.329536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.329538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.329540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.329541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.329542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.329543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.329544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.329550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.329560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.329565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.329569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.329572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.329576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.329580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.329583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.329587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.329591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.329595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.329598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.329602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.329605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.329612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.329619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.329627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.329632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.329638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.329643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.329648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.329653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.329658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.329663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.329668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.329673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.329679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.329685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.329694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.329699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.329704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.329712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.329717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.329723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.329732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.329737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.329741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.329746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.329750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.329755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.329759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.329764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.329807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:01.333961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:01.334661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:01.334677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:01.334680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:01.334685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:01.334693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2408 [2:7556256658429145245:8458]
2025-10-01T14:15:01.334713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:01.334736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:01.334743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.334747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.334750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.334765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:01.334776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:01.334783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:01.334878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.334886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.334889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.334893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:01.334897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:01.334971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:01.334979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.334991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.335005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.335024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:01.335047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057646:5086], now have 1 active actors on pipe
2025-10-01T14:15:01.335055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057366:2446], now have 1 active actors on pipe
2025-10-01T14:15:01.335061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.335063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.335066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.335082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:01.335101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:01.335115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:01.335119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:01.335123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:01.335124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:01.335125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:01.335158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.335166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:01.335168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:01.335137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2408
2025-10-01T14:15:01.335154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2408
2025-10-01T14:15:01.335195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.335202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.335236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fba6eae-413b0340-9a922afb-e8160257_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:01.335245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.335249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.335251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:01.335261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.335276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:01.335297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.335478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.335486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.335500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.335588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2409 partition: 0 MaxSeqNo: 45 sessionId: src_id|2fba6eae-413b0340-9a922afb-e8160257_0
2025-10-01T14:15:01.335994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ebe8ab-f9823047-d9542dbe-73fd78b9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2fba6eae-413b0340-9a922afb-e8160257_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:01.339150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Write session: try to update token
2025-10-01T14:15:01.339175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:01.354832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId: src_id|2fba6eae-413b0340-9a922afb-e8160257_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:01.357866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:01.357888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:01.357910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:01.357913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:01.357916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:01.357926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.357932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.357937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256658429145240:8458]
2025-10-01T14:15:01.357985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:01.357989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:01.357994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.357996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:01.357997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:01.358001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:01.358145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:01.402880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256660806057733:5192]
2025-10-01T14:15:01.403241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2408, pipe: [1:7556256660806057733:5192]
2025-10-01T14:15:01.496577Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:01.497504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.497523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.497561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057733:5192], now have 1 active actors on pipe
2025-10-01T14:15:01.497875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:01.497899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256660806057733:5192]
2025-10-01T14:15:01.497938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:01.497940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:01.497944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:01.498032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2409 reason: error at write: Disconnected sessionId: src_id|2fba6eae-413b0340-9a922afb-e8160257_0
2025-10-01T14:15:01.498261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2409 sessionId: src_id|2fba6eae-413b0340-9a922afb-e8160257_0 is DEAD
2025-10-01T14:15:01.498476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:01.498490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Write session will restart in 0.007405s
2025-10-01T14:15:01.498521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Write session: Do CDS request
2025-10-01T14:15:01.498527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:01.506971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.507051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:01.507073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2410
2025-10-01T14:15:01.507277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.507330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:01.507341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:01.507346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:01.507788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2410 sessionId:  describe result for acl check
2025-10-01T14:15:01.507833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:01.507843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:01.507845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:01.507850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256660806057771:5077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:01.508497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256660806057771:5077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:01.510746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256660806057771:5077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:01.514538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256660806057771:5077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:01.514560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256660806057771:5077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:01.514563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256660806057771:5077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:01.514571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:01.522003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:01.522448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:01.522651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:01.522661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:01.522673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:01.522734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:01.522785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256658429145490:8455]
2025-10-01T14:15:01.523389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:01.524882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:01.524976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:01.525357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:01.525417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.525426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.525428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.525429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.525431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.525432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.525434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.525435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.525437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.525438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.525439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.525441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.525442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.525443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.525450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.525460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.525464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.525469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.525472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.525476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.525480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.525484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.525488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.525492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.525496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.525500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.525504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.525507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.525515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.525524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.525530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.525535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.525542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.525547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.525551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.525557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.525561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.525567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.525571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.525576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.525581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.525586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.525591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.525595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.525601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.525606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.525611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.525617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.525621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.525626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.525630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.525636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.525641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.525646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.525657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.525662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.525703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:01.529762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:01.530593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:01.530616Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:01.530620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:01.530624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:01.530631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2409 [2:7556256658429145490:8455]
2025-10-01T14:15:01.530661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:01.530687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:01.530690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.530694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.530697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.530714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:01.530721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:01.530728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:01.530797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.530805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.530808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.530811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:01.530815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:01.530902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:01.530911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.530923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.531036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2409
2025-10-01T14:15:01.531094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2409
2025-10-01T14:15:01.530933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.530957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:01.530977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057738:2446], now have 1 active actors on pipe
2025-10-01T14:15:01.530982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806057932:5077], now have 1 active actors on pipe
2025-10-01T14:15:01.530989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.530991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.530994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.531011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:01.531025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:01.531028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:01.531029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:01.531031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:01.531042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:01.531046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:01.531086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.531093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:01.531098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:01.531260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.531273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.531299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:01.531310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.531320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.531323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:01.531335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.531351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:01.531374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.531605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.531615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.531631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.531732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2410 partition: 0 MaxSeqNo: 45 sessionId: src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0
2025-10-01T14:15:01.532152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fba6eae-413b0340-9a922afb-e8160257_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:01.535136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Write session: try to update token
2025-10-01T14:15:01.535152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:01.547263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:01.547287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:01.547300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.547359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:01.547359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:01.547593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:01.547771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:01.547942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:01.548114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:01.548367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:01.548422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:01.550243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId: src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:01.552986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:01.553218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.553247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.553287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:01.553362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:01.562966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:01.562992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:01.562996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:01.562998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:01.563010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.563015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.563019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256658429145485:8455]
2025-10-01T14:15:01.563075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:01.563087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.563096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:01.563273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:01.566435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:01.566456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:01.566461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:01.598255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256660806058110:5192]
2025-10-01T14:15:01.598527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2409, pipe: [1:7556256660806058110:5192]
2025-10-01T14:15:01.700979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:01.711153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.711186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.711381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.711451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.711530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.711603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.711661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.711672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.711748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.711817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.711893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.711970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.712028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.712042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.712128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.712207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.712279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.712359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.712425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.712434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.712515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.712604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.712678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.712753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.712815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.712824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.712904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.712978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.713106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.713191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.713253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.713260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.713343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.713431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.713506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.713587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.713648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.713656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.713737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.713938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.714016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.714097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.714159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.714167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.714292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.714413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.714526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.714604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.714667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.714676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.714760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.714834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.714910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.714988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.715839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256660806058110:5192]
2025-10-01T14:15:01.715896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:01.716359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:01.716372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:01.716400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2410 reason: error at write: Disconnected sessionId: src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0
2025-10-01T14:15:01.716627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2410 sessionId: src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0 is DEAD
2025-10-01T14:15:01.716783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:01.716793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Write session will restart in 0.008689s
2025-10-01T14:15:01.716819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Write session: Do CDS request
2025-10-01T14:15:01.716826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:01.715064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.715076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.715159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:01.715229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:01.715305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:01.715380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:01.715433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:01.715436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:01.715515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806058110:5192], now have 1 active actors on pipe
2025-10-01T14:15:01.717641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:01.726886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.726929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:01.726947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2411
2025-10-01T14:15:01.727117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.727164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:01.727174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:01.727178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:01.727626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2411 sessionId:  describe result for acl check
2025-10-01T14:15:01.727660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:01.727667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:01.727669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:01.727674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256660806058174:5050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:01.728110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256660806058174:5050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:01.730433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256660806058174:5050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:01.733611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256660806058174:5050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:01.733630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256660806058174:5050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:01.733633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256660806058174:5050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:01.733641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:01.741694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:01.744178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:01.744402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:01.744413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:01.744424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:01.744478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:01.744528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256658429145756:8451]
2025-10-01T14:15:01.745186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:01.745532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:01.745591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:01.745934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:01.746003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.746012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.746014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.746015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.746016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.746017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.746019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.746020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.746021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.746022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.746023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.746025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.746026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.746027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.746033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.746043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.746047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.746051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.746055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.746058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.746062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.746066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.746070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.746073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.746076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.746079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.746082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.746086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.746097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.746104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.746110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.746115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.746119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.746124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.746129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.746134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.746140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.746150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.746155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.746159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.746168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.746172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.746178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.746187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.746193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.746204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.746209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.746218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.746223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.746228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.746233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.746239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.746247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.746252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.746257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.746265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.746290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:01.750166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:01.751618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:01.751635Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:01.751637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:01.751641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:01.751648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2410 [2:7556256658429145756:8451]
2025-10-01T14:15:01.751665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:01.751681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:01.751684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.751687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.751690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.751706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:01.751716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:01.751722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:01.751784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.751791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.751793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.751796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:01.751798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:01.751871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:01.751879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.751890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.751903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.751923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:01.751944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806058141:2446], now have 1 active actors on pipe
2025-10-01T14:15:01.751954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806058368:5050], now have 1 active actors on pipe
2025-10-01T14:15:01.751960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.751966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.751969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.751985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:01.752002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:01.752021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:01.752029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:01.752030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:01.752034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:01.752040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:01.752064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.752078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:01.752062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2410
2025-10-01T14:15:01.752107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:01.752150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.752159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.752185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:01.752200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.752204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.752206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:01.752217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.752226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:01.752239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.752406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2410
2025-10-01T14:15:01.752485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.752493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.752509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.752627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2411 partition: 0 MaxSeqNo: 45 sessionId: src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0
2025-10-01T14:15:01.753000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2207cdd-dd57d6cf-a9864861-d1d11a6a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:01.756641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Write session: try to update token
2025-10-01T14:15:01.756664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:01.773384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:01.773405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:01.773407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:01.773409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:01.773417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.773421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.773426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256658429145751:8451]
2025-10-01T14:15:01.773471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:01.773473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:01.773479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.773480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:01.773482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:01.773484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:01.773633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:01.773713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId: src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:01.776236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:01.815866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256660806058506:5192]
2025-10-01T14:15:01.816242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2410, pipe: [1:7556256660806058506:5192]
2025-10-01T14:15:01.910639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:01.911035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.911063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.911106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806058506:5192], now have 1 active actors on pipe
2025-10-01T14:15:01.911394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:01.911367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:01.911371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256660806058506:5192]
2025-10-01T14:15:01.911415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:01.911418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:01.911475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2411 reason: error at write: Disconnected sessionId: src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0
2025-10-01T14:15:01.911653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2411 sessionId: src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0 is DEAD
2025-10-01T14:15:01.911809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:01.911820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Write session will restart in 0.006709s
2025-10-01T14:15:01.911842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Write session: Do CDS request
2025-10-01T14:15:01.911847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:01.919822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.919905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:01.919921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2412
2025-10-01T14:15:01.920021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:01.920045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:01.920052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:01.920055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:01.920388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2412 sessionId:  describe result for acl check
2025-10-01T14:15:01.920411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:01.920418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:01.920419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:01.920422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256660806058582:5042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:01.920833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256660806058582:5042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:01.922854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256660806058582:5042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:01.925941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256660806058582:5042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:01.925963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256660806058582:5042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:01.925966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256660806058582:5042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:01.925974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:01.930107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:01.932178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:01.932341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:01.932349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:01.932356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:01.932389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:01.932422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256658429146005:8448]
2025-10-01T14:15:01.932883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:01.933166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:01.933193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:01.933410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:01.933450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.933454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.933455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.933456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.933457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.933458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.933459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.933460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.933461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.933461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.933462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.933463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.933464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.933464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.933468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.933474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.933476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.933479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.933482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.933484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.933486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.933488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.933491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.933493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.933495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.933497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.933500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.933502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.933507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.933511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:01.933515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.933518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:01.933521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.933524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:01.933527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.933530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:01.933533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.933536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:01.933539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.933542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:01.933545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.933548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:01.933551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.933554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:01.933557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.933564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:01.933569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.933575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.933578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.933585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.933587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.933590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.933593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.933596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:01.933601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.933605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:01.933626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:01.937278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:01.937963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:01.937976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:01.937979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:01.937982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:01.937988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2411 [2:7556256658429146005:8448]
2025-10-01T14:15:01.938001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:01.938017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:01.938023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.938026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.938028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.938042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:01.938049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:01.938055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:01.938105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.938111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.938113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.938116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:01.938117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:01.938174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:01.938179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.938187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:01.938193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:01.938206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:01.938224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806058509:2446], now have 1 active actors on pipe
2025-10-01T14:15:01.938230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256660806058796:5042], now have 1 active actors on pipe
2025-10-01T14:15:01.938234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.938236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.938238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.938248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:01.938261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:01.938262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:01.938265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:01.938266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:01.938272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:01.938276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:01.938300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.938306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:01.938308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:01.938334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.938340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.938360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:01.938298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2411
2025-10-01T14:15:01.938387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:01.938396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:01.938398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:01.938310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2411
2025-10-01T14:15:01.938409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:01.938422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:01.938440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.938591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.938601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.938617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:01.938697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2412 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0
2025-10-01T14:15:01.939018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27270c37-4f94a14d-857d66aa-1c4b6ccd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:01.942016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Write session: try to update token
2025-10-01T14:15:01.942033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:01.956149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId: src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:01.958973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:01.959076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:01.959100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:01.959103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:01.959106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:01.959115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.959119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.959125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256658429146000:8448]
2025-10-01T14:15:01.959151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:01.959156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:01.959158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:01.959179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:01.959188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:01.959204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:01.959217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:01.959224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:01.959385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:02.011421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256665101026189:5192]
2025-10-01T14:15:02.011743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2411, pipe: [1:7556256665101026189:5192]
2025-10-01T14:15:02.099916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:02.100304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026189:5192], now have 1 active actors on pipe
2025-10-01T14:15:02.100537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:02.100569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:02.100591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:02.100573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:02.100620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256665101026189:5192]
2025-10-01T14:15:02.100640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2412 reason: error at write: Disconnected sessionId: src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0
2025-10-01T14:15:02.100821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2412 sessionId: src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0 is DEAD
2025-10-01T14:15:02.101222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:02.101232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Write session will restart in 0.009124s
2025-10-01T14:15:02.101256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Write session: Do CDS request
2025-10-01T14:15:02.101261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:02.111853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.112030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:02.112053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2413
2025-10-01T14:15:02.112181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.112216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:02.112227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:02.112231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:02.112672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2413 sessionId:  describe result for acl check
2025-10-01T14:15:02.112713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:02.112720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:02.112721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:02.112726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256665101026351:5016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:02.113264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256665101026351:5016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:02.115290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256665101026351:5016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:02.118143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256665101026351:5016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:02.118159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256665101026351:5016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:02.118163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256665101026351:5016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:02.118169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:02.121512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:02.122026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:02.122204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:02.122214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:02.122225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:02.122273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:02.122315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256662724113578:8429]
2025-10-01T14:15:02.122931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:02.123232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:02.123277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:02.123584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:02.123651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.123657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.123658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.123659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.123660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.123661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.123662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.123663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.123664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.123665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.123666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.123667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.123668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.123669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.123674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.123684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.123687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.123691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.123694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.123697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.123701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.123704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.123708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.123712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.123715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.123719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.123722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.123725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.123733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.123740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.123746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.123750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.123754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.123759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.123764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.123775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.123780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.123784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.123794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.123798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.123803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.123812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.123815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.123820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.123827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.123832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.123836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.123840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.123849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.123853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.123861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.123866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.123874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.123878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.123882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.123890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.123926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:02.127627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:02.128405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:02.128420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:02.128422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:02.128426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:02.128431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2412 [2:7556256662724113578:8429]
2025-10-01T14:15:02.128443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:02.128456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:02.128458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.128461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.128462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.128473Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:02.128476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:02.128482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:02.128557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.128565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.128568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.128572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:02.128575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:02.128629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:02.128635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.128641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.128648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.128661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:02.128685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026546:5016], now have 1 active actors on pipe
2025-10-01T14:15:02.128693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026193:2446], now have 1 active actors on pipe
2025-10-01T14:15:02.128701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.128703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.128706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.128719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:02.128730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:02.128732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:02.128734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:02.128737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:02.128750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:02.128758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:02.128784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.128790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:02.128793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:02.128763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2412
2025-10-01T14:15:02.128779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2412
2025-10-01T14:15:02.128810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.128818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.129270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:02.129284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.129289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.129293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:02.129302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.129312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:02.129335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.129528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.129538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.129552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.129628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2413 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0
2025-10-01T14:15:02.129955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac9342a-4cc94210-7f4ba2af-1ec048e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:02.132713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Write session: try to update token
2025-10-01T14:15:02.132731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:02.149013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId: src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:02.150849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:02.150872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:02.150875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:02.150877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:02.150883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.150888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.150892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256662724113573:8429]
2025-10-01T14:15:02.150937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:02.150944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.150946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:02.150948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:02.150953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:02.150957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:02.151120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:02.151743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:02.200884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256665101026564:5192]
2025-10-01T14:15:02.201221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2412, pipe: [1:7556256665101026564:5192]
2025-10-01T14:15:02.288007Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:02.288400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.288417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.288457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026564:5192], now have 1 active actors on pipe
2025-10-01T14:15:02.288754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:02.288802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256665101026564:5192]
2025-10-01T14:15:02.288847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:02.288940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2413 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0
2025-10-01T14:15:02.288944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:02.289193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2413 sessionId: src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0 is DEAD
2025-10-01T14:15:02.289307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:02.289316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Write session will restart in 0.008351s
2025-10-01T14:15:02.289342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Write session: Do CDS request
2025-10-01T14:15:02.289348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:02.298923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.299020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:02.299043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2414
2025-10-01T14:15:02.299181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.299227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:02.299240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:02.299245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:02.299635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2414 sessionId:  describe result for acl check
2025-10-01T14:15:02.299672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:02.299674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:02.299675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:02.299679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256665101026635:5007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:02.300181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256665101026635:5007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:02.302755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256665101026635:5007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:02.305855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256665101026635:5007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:02.305872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256665101026635:5007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:02.305876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256665101026635:5007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:02.305884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:02.308931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:02.311089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:02.311264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:02.311273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:02.311281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:02.311325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:02.311371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256662724113831:8421]
2025-10-01T14:15:02.311977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:02.312262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:02.312300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:02.312612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:02.312660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.312661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.312662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.312663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.312665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.312666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.312667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.312668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.312669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.312670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.312671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.312673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.312674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.312675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.312680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.312690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.312694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.312698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.312702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.312706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.312710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.312713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.312716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.312720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.312723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.312726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.312729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.312733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.312740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.312747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.312754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.312759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.312763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.312768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.312771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.312776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.312781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.312786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.312790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.312795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.312799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.312804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.312808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.312813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.312817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.312822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.312827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.312832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.312837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.312841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.312846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.312851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.312855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.312860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.312864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.312868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.312904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:02.316742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:02.317769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:02.317774Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:02.317776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:02.317780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:02.317786Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2413 [2:7556256662724113831:8421]
2025-10-01T14:15:02.317801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:02.317818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:02.317821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.317824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.317826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.317840Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:02.317846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:02.317852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:02.317909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.317912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.317914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.317917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:02.317920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:02.317983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:02.317985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.317995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.318004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.318020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:02.318035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.318038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.318040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.318049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:02.318061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:02.318074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:02.318077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:02.318099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.318102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:02.318288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:02.318294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:02.318297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:02.318302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:02.318554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026885:5007], now have 1 active actors on pipe
2025-10-01T14:15:02.318563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026566:2446], now have 1 active actors on pipe
2025-10-01T14:15:02.318596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2413
2025-10-01T14:15:02.318642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2413
2025-10-01T14:15:02.318769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.318779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.318806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:02.318813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.318817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.318820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:02.318829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.318838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:02.318851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.319131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.319138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.319152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.319312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2414 partition: 0 MaxSeqNo: 45 sessionId: src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0
2025-10-01T14:15:02.319740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab591b7-6b8721c0-7524a1fc-45fbebad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:02.322708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Write session: try to update token
2025-10-01T14:15:02.322722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:02.337517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId: src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:02.340122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:02.340147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:02.340150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:02.340151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:02.340165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.340195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:02.340170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.340175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256662724113826:8421]
2025-10-01T14:15:02.340229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:02.340237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.340240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:02.340255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:02.340262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:02.340267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:02.340383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:02.388778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256665101026938:5192]
2025-10-01T14:15:02.389154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2413, pipe: [1:7556256665101026938:5192]
2025-10-01T14:15:02.485684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:02.486037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.486052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.486090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026938:5192], now have 1 active actors on pipe
2025-10-01T14:15:02.486345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:02.486385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256665101026938:5192]
2025-10-01T14:15:02.486400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:02.486403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:02.486419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:02.486465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2414 reason: error at write: Disconnected sessionId: src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0
2025-10-01T14:15:02.486645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2414 sessionId: src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0 is DEAD
2025-10-01T14:15:02.486778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:02.486791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Write session will restart in 0.007631s
2025-10-01T14:15:02.486820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Write session: Do CDS request
2025-10-01T14:15:02.486826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:02.495848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.495943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:02.495971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2415
2025-10-01T14:15:02.496086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.496118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:02.496131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:02.496134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:02.496491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2415 sessionId:  describe result for acl check
2025-10-01T14:15:02.496528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:02.496530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:02.496531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:02.496534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256665101027058:4993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:02.496988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256665101027058:4993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:02.499580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256665101027058:4993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:02.502553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256665101027058:4993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:02.502570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256665101027058:4993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:02.502573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256665101027058:4993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:02.502582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:02.503707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:02.505454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:02.505628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:02.505637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:02.505646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:02.505689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:02.505727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256662724114081:8420]
2025-10-01T14:15:02.506320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:02.506572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:02.506622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:02.506936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:02.506988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.506994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.506995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.506996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.506997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.506998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.506999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.507000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.507001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.507002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.507003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.507004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.507005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.507006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.507012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.507022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.507026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.507030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.507033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.507037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.507041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.507044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.507048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.507052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.507055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.507059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.507062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.507065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.507071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.507078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.507083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.507087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.507094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.507099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.507103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.507107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.507111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.507116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.507120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.507125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.507129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.507134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.507140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.507149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.507153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.507158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.507166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.507172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.507181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.507185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.507191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.507200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.507204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.507212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.507216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.507220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.507256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:02.510951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:02.511735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:02.511748Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:02.511750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:02.511754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:02.511760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2414 [2:7556256662724114081:8420]
2025-10-01T14:15:02.511776Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:02.511791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:02.511795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.511798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.511800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.511813Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:02.511824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:02.511829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:02.511899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.511906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.511909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.511914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:02.511916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:02.511976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:02.511983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.511992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.512002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.512020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:02.512041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101027300:4993], now have 1 active actors on pipe
2025-10-01T14:15:02.512048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101026940:2446], now have 1 active actors on pipe
2025-10-01T14:15:02.512054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.512062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.512064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.512078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:02.512094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:02.512102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:02.512107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:02.512109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:02.512111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:02.512114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:02.512137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.512144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:02.512147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:02.512165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.512174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.512104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2414
2025-10-01T14:15:02.512129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2414
2025-10-01T14:15:02.512584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:02.512598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.512603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.512605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:02.512615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.512628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:02.512654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.512831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.512839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.512852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.512933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2415 partition: 0 MaxSeqNo: 45 sessionId: src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0
2025-10-01T14:15:02.513296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e0c378-23c6bf37-282aacaa-4f577689_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:02.516112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Write session: try to update token
2025-10-01T14:15:02.516133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:02.529257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId: src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:02.531809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:02.533939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.533966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.533990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:02.533993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:02.533997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:02.534000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:02.534009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.534014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.534020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256662724114076:8420]
2025-10-01T14:15:02.534064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:02.534079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:02.534079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:02.534084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:02.534085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.534087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:02.534242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:02.586444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256665101027316:5192]
2025-10-01T14:15:02.586750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2414, pipe: [1:7556256665101027316:5192]
2025-10-01T14:15:02.671186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:02.671474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:02.671532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101027316:5192], now have 1 active actors on pipe
2025-10-01T14:15:02.671672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:02.671815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256665101027316:5192]
2025-10-01T14:15:02.671844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:02.683995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:02.684016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:02.684042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2415 reason: error at write: Disconnected sessionId: src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0
2025-10-01T14:15:02.684195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2415 sessionId: src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0 is DEAD
2025-10-01T14:15:02.684366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:02.684377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Write session will restart in 0.006589s
2025-10-01T14:15:02.684419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Write session: Do CDS request
2025-10-01T14:15:02.684425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:02.691938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.692023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:02.692046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2416
2025-10-01T14:15:02.692170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.692204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:02.692213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:02.692217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:02.692605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2416 sessionId:  describe result for acl check
2025-10-01T14:15:02.692642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:02.692649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:02.692651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:02.692656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256665101027511:4962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:02.693205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256665101027511:4962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:02.695723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256665101027511:4962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:02.699022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256665101027511:4962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:02.699036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256665101027511:4962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:02.699039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256665101027511:4962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:02.699047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:02.700178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:02.702520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:02.702723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:02.702731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:02.702742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:02.702794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:02.702849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256662724114344:8415]
2025-10-01T14:15:02.703477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:02.703776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:02.703816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:02.704112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:02.704170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.704176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.704177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.704178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.704179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.704181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.704182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.704183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.704185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.704186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.704187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.704189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.704190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.704191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.704195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.704205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.704209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.704212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.704226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.704230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.704234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.704237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.704241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.704245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.704248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.704251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.704255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.704259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.704265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.704273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.704283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.704288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.704293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.704300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.704308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.704312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.704317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.704321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.704325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.704330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.704334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.704344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.704348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.704356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.704362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.704371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.704375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.704384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.704389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.704398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.704402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.704406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.704415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.704420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.704427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.704432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.704478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:02.708401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:02.709140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:02.709152Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:02.709154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:02.709157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:02.709162Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2415 [2:7556256662724114344:8415]
2025-10-01T14:15:02.709174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:02.709190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:02.709197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.709201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.709203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.709218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:02.709226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:02.709231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:02.709279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.709284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.709285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.709288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:02.709290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:02.709339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:02.709347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.709354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.709360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.709369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:02.709382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101027324:2446], now have 1 active actors on pipe
2025-10-01T14:15:02.709385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101027695:4962], now have 1 active actors on pipe
2025-10-01T14:15:02.709390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.709392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.709394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.709403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:02.709413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:02.709414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:02.709416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:02.709418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:02.709440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:02.709449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:02.709473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.709483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:02.709500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:02.709492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2415
2025-10-01T14:15:02.709532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2415
2025-10-01T14:15:02.709645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.709655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.709680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:02.709689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.709692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.709694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:02.709701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.709707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:02.709720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.709871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.709877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.709886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.709996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2416 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0
2025-10-01T14:15:02.710391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbcb8cf-1aeeb787-50156306-ad8d3556_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:02.713389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Write session: try to update token
2025-10-01T14:15:02.713410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:02.727416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:02.727439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:02.727461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.727515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:02.727517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:02.727722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:02.727891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:02.728043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:02.728188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:02.728410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:02.728454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:02.736958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId: src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:02.739824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:02.741253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.741286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.741310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:02.741312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:02.741316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:02.741318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:02.741328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.741332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.741337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256662724114339:8415]
2025-10-01T14:15:02.741381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:02.741388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:02.741392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:02.741399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:02.741406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.741408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:02.741544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:02.771756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256665101027719:5192]
2025-10-01T14:15:02.772028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2415, pipe: [1:7556256665101027719:5192]
2025-10-01T14:15:02.894339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:02.894774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:02.894818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101027719:5192], now have 1 active actors on pipe
2025-10-01T14:15:02.894923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:02.895015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:02.895032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:02.895036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:02.895072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256665101027719:5192]
2025-10-01T14:15:02.895113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2416 reason: error at write: Disconnected sessionId: src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0
2025-10-01T14:15:02.895280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2416 sessionId: src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0 is DEAD
2025-10-01T14:15:02.895414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:02.895423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Write session will restart in 0.007218s
2025-10-01T14:15:02.895461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Write session: Do CDS request
2025-10-01T14:15:02.895470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:02.903964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.904413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:02.904433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2417
2025-10-01T14:15:02.904582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:02.904628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:02.904639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:02.904643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:02.905062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2417 sessionId:  describe result for acl check
2025-10-01T14:15:02.905099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:02.905101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:02.905104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:02.905110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256665101027809:4951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:02.905662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256665101027809:4951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:02.908856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256665101027809:4951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:02.915203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256665101027809:4951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:02.915225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256665101027809:4951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:02.915229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256665101027809:4951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:02.915238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:02.916024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:02.918005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:02.918214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:02.918228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:02.918241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:02.918310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:02.918357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256662724114605:8391]
2025-10-01T14:15:02.918983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:02.919328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:02.919406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:02.919895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:02.919967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.919974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.919975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.919977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.919978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.919980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.919982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.919983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.919984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.919985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.919986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.919987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.919989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.919990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.919996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.920007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.920012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.920016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.920020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.920025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.920029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.920033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.920037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.920041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.920045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.920050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.920054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.920058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.920065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.920095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:02.920102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.920108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:02.920113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.920118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:02.920123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.920134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:02.920140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.920149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:02.920154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.920159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:02.920165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.920171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:02.920180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.920186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:02.920195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.920201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:02.920210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.920216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.920225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.920230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.920235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.920241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.920245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.920251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:02.920255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.920265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:02.920305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:02.924101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:02.925177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:02.925195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:02.925197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:02.925201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:02.925208Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2416 [2:7556256662724114605:8391]
2025-10-01T14:15:02.925226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:02.925244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:02.925247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.925251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.925254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.925270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:02.925280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:02.925287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:02.925344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.925352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.925354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.925358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:02.925361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:02.925432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:02.925440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.925452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:02.925469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:02.925491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:02.925517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101028083:4951], now have 1 active actors on pipe
2025-10-01T14:15:02.925525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.925528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.925530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.925544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:02.925556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:02.925559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:02.925559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101027722:2446], now have 1 active actors on pipe
2025-10-01T14:15:02.925561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:02.925567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:02.925581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:02.925589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:02.925597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2416
2025-10-01T14:15:02.925628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.925640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:02.925602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2416
2025-10-01T14:15:02.925656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:02.925924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.925937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.925963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:02.925970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:02.925976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:02.925984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:02.925993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:02.926002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:02.926016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.926203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:02.926211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:02.926226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:02.926312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2417 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0
2025-10-01T14:15:02.926680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf456d71-27f0a1be-b49b6312-5ce0deb8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:02.929836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Write session: try to update token
2025-10-01T14:15:02.929853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:02.945656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId: src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:02.947461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:02.947479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:02.947481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:02.947483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:02.947491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.947495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.947497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256662724114600:8391]
2025-10-01T14:15:02.947541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:02.947546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:02.947546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:02.947548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:02.947551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:02.947554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:02.947670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:02.948264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:02.994982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256665101028097:5192]
2025-10-01T14:15:02.996372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2416, pipe: [1:7556256665101028097:5192]
2025-10-01T14:15:03.105752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:03.106282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.106301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.106347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256665101028097:5192], now have 1 active actors on pipe
2025-10-01T14:15:03.106632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256665101028097:5192]
2025-10-01T14:15:03.106669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:03.106847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:03.106916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:03.106931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:03.106992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2417 reason: error at write: Disconnected sessionId: src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0
2025-10-01T14:15:03.107192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2417 sessionId: src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0 is DEAD
2025-10-01T14:15:03.107312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:03.107323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Write session will restart in 0.007835s
2025-10-01T14:15:03.107352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Write session: Do CDS request
2025-10-01T14:15:03.107358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:03.115902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.115966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:03.115983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2418
2025-10-01T14:15:03.116095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.116127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:03.116136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:03.116139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:03.116499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2418 sessionId:  describe result for acl check
2025-10-01T14:15:03.116531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:03.116536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:03.116538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:03.116543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256669395995541:4929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:03.117066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256669395995541:4929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:03.118942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256669395995541:4929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:03.121300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256669395995541:4929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:03.121313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256669395995541:4929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:03.121316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256669395995541:4929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:03.121321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:03.126602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:03.128636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:03.128811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:03.128826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:03.128838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:03.128883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:03.128923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256667019082183:8385]
2025-10-01T14:15:03.129329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:03.129600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:03.129634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:03.129909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:03.129966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.129972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.129972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.129973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.129985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.129991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.129992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.129993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.129994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.129995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.129997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.129998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.129999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.130000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.130005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.130014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.130019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.130022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.130025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.130029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.130032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.130035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.130038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.130041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.130045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.130048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.130052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.130055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.130062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.130069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.130075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.130085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.130091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.130101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.130105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.130113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.130118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.130123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.130127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.130133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.130138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.130146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.130150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.130155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.130159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.130168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.130172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.130177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.130181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.130186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.130190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.130195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.130204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.130209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.130217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.130226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.130263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:03.133880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:03.134618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:03.134631Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:03.134633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:03.134636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:03.134644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2417 [2:7556256667019082183:8385]
2025-10-01T14:15:03.134659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:03.134675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:03.134682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.134686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.134688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.134703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:03.134712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:03.134719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:03.134776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.134783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.134785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.134788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:03.134791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:03.134852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:03.134859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.134869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.134882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.134900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:03.134921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395995654:4929], now have 1 active actors on pipe
2025-10-01T14:15:03.134928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395995412:2446], now have 1 active actors on pipe
2025-10-01T14:15:03.134936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.134944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.134947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.134960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:03.134975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:03.134981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:03.134983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:03.134985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:03.134995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:03.134998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:03.134978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2417
2025-10-01T14:15:03.134978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2417
2025-10-01T14:15:03.135027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.135037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:03.135043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:03.135061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.135070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.135116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:03.135126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.135130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.135134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:03.135144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.135155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:03.135174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.135284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.135291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.135304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.135378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2418 partition: 0 MaxSeqNo: 45 sessionId: src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0
2025-10-01T14:15:03.135744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0c3877-b3844f9a-3efae305-bd0faf5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:03.138416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Write session: try to update token
2025-10-01T14:15:03.138432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:03.155359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:03.155382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:03.155386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:03.155391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:03.155401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.155409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.155414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256667019082178:8385]
2025-10-01T14:15:03.155469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:03.155472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:03.155485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.155489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:03.155496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:03.155503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:03.155632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:03.156937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId: src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:03.159527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:03.206965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256669395995785:5192]
2025-10-01T14:15:03.207232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2417, pipe: [1:7556256669395995785:5192]
2025-10-01T14:15:03.301037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:03.301908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.301923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.301961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395995785:5192], now have 1 active actors on pipe
2025-10-01T14:15:03.302160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:03.302177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:03.302183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256669395995785:5192]
2025-10-01T14:15:03.302198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:03.302229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:03.302247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2418 reason: error at write: Disconnected sessionId: src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0
2025-10-01T14:15:03.302446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2418 sessionId: src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0 is DEAD
2025-10-01T14:15:03.302575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:03.302585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Write session will restart in 0.008027s
2025-10-01T14:15:03.302613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Write session: Do CDS request
2025-10-01T14:15:03.302631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:03.311960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.312481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:03.312500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2419
2025-10-01T14:15:03.312638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.312670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:03.312680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:03.312685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:03.313112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2419 sessionId:  describe result for acl check
2025-10-01T14:15:03.313146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:03.313152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:03.313154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:03.313159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256669395995825:4914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:03.313724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256669395995825:4914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:03.317279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256669395995825:4914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:03.319851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256669395995825:4914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:03.319866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256669395995825:4914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:03.319869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256669395995825:4914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:03.319878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:03.328940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:03.331594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:03.331856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:03.331871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:03.331884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:03.331958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:03.332003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256667019082441:8378]
2025-10-01T14:15:03.332631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:03.333019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:03.333079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:03.333439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:03.333503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.333509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.333510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.333511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.333513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.333514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.333515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.333517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.333518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.333520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.333521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.333522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.333523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.333525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.333531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.333541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.333546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.333550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.333554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.333558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.333562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.333566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.333570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.333574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.333577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.333581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.333585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.333588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.333597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.333605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.333611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.333617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.333622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.333627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.333636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.333645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.333654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.333659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.333663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.333674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.333684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.333694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.333699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.333708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.333715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.333720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.333724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.333733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.333737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.333743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.333753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.333757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.333767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.333776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.333782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.333793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.333834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:03.337639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:03.339181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:03.339199Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:03.339202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:03.339206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:03.339213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2418 [2:7556256667019082441:8378]
2025-10-01T14:15:03.339233Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:03.339251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:03.339260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.339264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.339266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.339284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:03.339296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:03.339302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:03.339372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.339380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.339382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.339385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:03.339388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:03.339453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:03.339460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.339470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.339476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.339486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:03.339501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.339503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.339506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.339514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:03.339529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:03.339531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:03.339534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:03.339536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:03.339543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:03.339546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:03.339556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395995787:2446], now have 1 active actors on pipe
2025-10-01T14:15:03.339596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996067:4914], now have 1 active actors on pipe
2025-10-01T14:15:03.339606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.339613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:03.339626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:03.339647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2418
2025-10-01T14:15:03.339650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2418
2025-10-01T14:15:03.339713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.339722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.339747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3543fcc9-8000c85e-32603289-cf07e072_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:03.339756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.339759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.339760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:03.339767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.339773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:03.339785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.340028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2419 partition: 0 MaxSeqNo: 45 sessionId: src_id|3543fcc9-8000c85e-32603289-cf07e072_0
2025-10-01T14:15:03.339944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.339950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.339959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.340411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d60f6-643988f4-741342c1-ec66ffa6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3543fcc9-8000c85e-32603289-cf07e072_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:03.343403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Write session: try to update token
2025-10-01T14:15:03.343420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:03.359880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId: src_id|3543fcc9-8000c85e-32603289-cf07e072_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:03.360915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:03.360932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:03.360934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:03.360936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:03.360943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.360947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.360950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256667019082436:8378]
2025-10-01T14:15:03.360996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:03.361000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:03.361001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:03.361004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:03.361006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.361009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:03.361149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:03.362575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:03.402548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256669395996164:5192]
2025-10-01T14:15:03.402807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2418, pipe: [1:7556256669395996164:5192]
2025-10-01T14:15:03.508353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:03.508672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.508687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.508731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996164:5192], now have 1 active actors on pipe
2025-10-01T14:15:03.509004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:03.509021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:03.509079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2419 reason: error at write: Disconnected sessionId: src_id|3543fcc9-8000c85e-32603289-cf07e072_0
2025-10-01T14:15:03.509147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:03.509239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256669395996164:5192]
2025-10-01T14:15:03.509278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2419 sessionId: src_id|3543fcc9-8000c85e-32603289-cf07e072_0 is DEAD
2025-10-01T14:15:03.508942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:03.509442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:03.509450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Write session will restart in 0.007499s
2025-10-01T14:15:03.509480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Write session: Do CDS request
2025-10-01T14:15:03.509486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:03.517958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.518021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:03.518041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2420
2025-10-01T14:15:03.518223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.518270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:03.518275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:03.518279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:03.519061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2420 sessionId:  describe result for acl check
2025-10-01T14:15:03.519108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:03.519121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:03.519123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:03.519130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256669395996242:4898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:03.519733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256669395996242:4898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:03.521999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256669395996242:4898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:03.524787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256669395996242:4898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:03.524805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256669395996242:4898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:03.524808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256669395996242:4898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:03.524814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:03.528057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:03.530327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:03.530602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:03.530613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:03.530622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:03.530666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:03.530699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256667019082696:8367]
2025-10-01T14:15:03.531247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:03.531605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:03.531661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:03.531993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:03.532064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.532071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.532072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.532073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.532074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.532075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.532077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.532078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.532079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.532080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.532081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.532082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.532083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.532084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.532090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.532099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.532103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.532107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.532111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.532115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.532118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.532122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.532125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.532130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.532133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.532137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.532140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.532144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.532153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.532161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.532168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.532173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.532178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.532184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.532189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.532194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.532199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.532204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.532208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.532214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.532218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.532223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.532233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.532238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.532246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.532255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.532259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.532269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.532277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.532283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.532292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.532296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.532303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.532308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.532316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.532321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.532364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:03.536372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:03.537375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:03.537392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:03.537395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:03.537399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:03.537406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2419 [2:7556256667019082696:8367]
2025-10-01T14:15:03.537421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:03.537437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:03.537445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.537449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.537452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.537468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:03.537478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:03.537485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:03.537544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.537553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.537555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.537559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:03.537561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:03.537857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2419
2025-10-01T14:15:03.537904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2419
2025-10-01T14:15:03.537627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:03.537638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.537651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.537661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.537679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:03.537698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996470:4898], now have 1 active actors on pipe
2025-10-01T14:15:03.537701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996167:2446], now have 1 active actors on pipe
2025-10-01T14:15:03.537708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.537710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.537712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.537727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:03.537741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:03.537745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:03.537748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:03.537751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:03.537756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:03.537759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:03.537794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.537802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:03.537807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:03.538119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.538134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.538167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ec95afa-749fea22-d65979dc-d9d34506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:03.538180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.538187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.538189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:03.538199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.538214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:03.538233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.539471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.539487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.539514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.539630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2420 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ec95afa-749fea22-d65979dc-d9d34506_0
2025-10-01T14:15:03.539990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3543fcc9-8000c85e-32603289-cf07e072_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ec95afa-749fea22-d65979dc-d9d34506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:03.542795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Write session: try to update token
2025-10-01T14:15:03.542814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:03.556924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId: src_id|5ec95afa-749fea22-d65979dc-d9d34506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:03.559097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:03.559117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:03.559119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:03.559121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:03.559129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.559132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.559135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256667019082691:8367]
2025-10-01T14:15:03.559177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:03.559186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.559188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:03.559187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:03.559194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:03.559197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:03.559316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:03.559354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:03.609357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256669395996551:5192]
2025-10-01T14:15:03.609554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2419, pipe: [1:7556256669395996551:5192]
2025-10-01T14:15:03.701977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:03.702364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.702392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.702442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996551:5192], now have 1 active actors on pipe
2025-10-01T14:15:03.702615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:03.702664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:03.702680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:03.702685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256669395996551:5192]
2025-10-01T14:15:03.702704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:03.702739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2420 reason: error at write: Disconnected sessionId: src_id|5ec95afa-749fea22-d65979dc-d9d34506_0
2025-10-01T14:15:03.702945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2420 sessionId: src_id|5ec95afa-749fea22-d65979dc-d9d34506_0 is DEAD
2025-10-01T14:15:03.703087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:03.703098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Write session will restart in 0.009117s
2025-10-01T14:15:03.703137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Write session: Do CDS request
2025-10-01T14:15:03.703143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:03.713989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.713999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:03.714018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2421
2025-10-01T14:15:03.714178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.714210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:03.714216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:03.714219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:03.714638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2421 sessionId:  describe result for acl check
2025-10-01T14:15:03.714677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:03.714679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:03.714681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:03.714686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256669395996783:4879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:03.715203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256669395996783:4879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:03.717978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256669395996783:4879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:03.719738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:03.722305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:03.722435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256669395996783:4879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:03.722456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256669395996783:4879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:03.722459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256669395996783:4879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:03.722467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:03.722540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:03.722550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:03.722561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:03.722613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:03.722844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256667019082963:8374]
2025-10-01T14:15:03.723223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:03.723500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:03.723543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:03.723756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:03.723798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.723803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.723803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.723804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.723805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.723805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.723806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.723806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.723807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.723808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.723808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.723809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.723810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.723810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.723814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.723819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.723821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.723824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.723826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.723828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.723830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.723832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.723834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.723837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.723839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.723841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.723843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.723845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.723851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.723855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.723859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.723862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.723865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.723868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.723871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.723874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.723877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.723881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.723883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.723886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.723889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.723892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.723894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.723897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.723899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.723902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.723905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.723908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.723910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.723912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.723915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.723918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.723921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.723924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.723926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.723928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.723948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:03.727820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:03.728530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:03.728558Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:03.728560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:03.728564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:03.728576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2420 [2:7556256667019082963:8374]
2025-10-01T14:15:03.728592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:03.728612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:03.728619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.728623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.728625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.728642Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:03.728655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:03.728661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:03.728722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.728730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.728732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.728735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:03.728738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:03.728808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:03.728816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.728828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.728841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.728861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:03.728885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996555:2446], now have 1 active actors on pipe
2025-10-01T14:15:03.728894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996922:4879], now have 1 active actors on pipe
2025-10-01T14:15:03.728901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.728904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.728906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.728918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:03.728935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:03.728938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:03.728941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:03.728943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:03.728952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:03.728955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:03.728911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2420
2025-10-01T14:15:03.728962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2420
2025-10-01T14:15:03.728997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.729009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:03.729023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.729032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.729036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:03.729074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ae15a68-fa244679-f93f1314-feb285b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:03.729090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.729094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.729096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:03.729105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.729113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:03.729135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.729279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.729287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.729300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.729370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2421 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ae15a68-fa244679-f93f1314-feb285b2_0
2025-10-01T14:15:03.729760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec95afa-749fea22-d65979dc-d9d34506_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ae15a68-fa244679-f93f1314-feb285b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:03.732736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Write session: try to update token
2025-10-01T14:15:03.732754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:03.748682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId: src_id|9ae15a68-fa244679-f93f1314-feb285b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:03.750113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:03.750141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:03.750143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:03.750145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:03.750155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.750160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.750166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256667019082958:8374]
2025-10-01T14:15:03.750219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:03.750221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:03.750228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.750230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:03.750232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:03.750236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:03.750476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:03.751597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:03.802922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256669395996955:5192]
2025-10-01T14:15:03.803188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2420, pipe: [1:7556256669395996955:5192]
2025-10-01T14:15:03.912722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:03.912785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:03.912788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:03.912849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2421 reason: error at write: Disconnected sessionId: src_id|9ae15a68-fa244679-f93f1314-feb285b2_0
2025-10-01T14:15:03.913049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2421 sessionId: src_id|9ae15a68-fa244679-f93f1314-feb285b2_0 is DEAD
2025-10-01T14:15:03.913181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256669395996955:5192]
2025-10-01T14:15:03.913336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:03.913348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Write session will restart in 0.008062s
2025-10-01T14:15:03.913377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Write session: Do CDS request
2025-10-01T14:15:03.911580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:03.911999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.912009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.912057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996955:5192], now have 1 active actors on pipe
2025-10-01T14:15:03.912994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:03.913385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:03.923571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.924906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:03.924931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2422
2025-10-01T14:15:03.925109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:03.925140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:03.925146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:03.925150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:03.925519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2422 sessionId:  describe result for acl check
2025-10-01T14:15:03.925545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:03.925546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:03.925547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:03.925552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256669395996974:4841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:03.925985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256669395996974:4841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:03.929001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256669395996974:4841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:03.936176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256669395996974:4841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:03.936199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256669395996974:4841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:03.936203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256669395996974:4841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:03.936212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:03.948582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:03.951499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:03.951769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:03.951783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:03.951797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:03.951877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:03.951927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256667019083230:8369]
2025-10-01T14:15:03.952646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:03.953004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:03.953065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:03.953386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:03.953473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.953479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.953480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.953481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.953482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.953483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.953484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.953485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.953487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.953488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.953489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.953490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.953491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.953492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.953499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.953509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.953513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.953516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.953520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.953524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.953528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.953531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.953535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.953539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.953542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.953546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.953549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.953553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.953560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.953567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:03.953574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.953579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:03.953584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.953588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:03.953593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.953598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:03.953602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.953607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:03.953612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.953617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:03.953622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.953627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:03.953631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.953636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:03.953640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.953645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:03.953649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.953654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.953659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.953665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.953669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.953674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.953679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.953683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:03.953687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.953692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:03.953731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:03.957752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:03.959133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:03.959155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:03.959158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:03.959163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:03.959170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2421 [2:7556256667019083230:8369]
2025-10-01T14:15:03.959190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:03.959209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:03.959221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.959225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.959228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.959247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:03.959258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:03.959265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:03.959347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.959356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.959358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.959362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:03.959364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:03.959446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:03.959456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.959469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:03.959481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:03.959495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:03.959516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395997133:4841], now have 1 active actors on pipe
2025-10-01T14:15:03.959521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256669395996958:2446], now have 1 active actors on pipe
2025-10-01T14:15:03.959529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.959531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.959533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.959549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:03.959564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:03.959580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:03.959583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:03.959598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2421
2025-10-01T14:15:03.959642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2421
2025-10-01T14:15:03.959626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.959641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:03.959686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:03.959695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:03.959697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:03.959703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:03.959837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.959848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.959878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d593c86-1728bb77-df0961e1-ebde4648_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:03.959893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:03.959897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:03.959904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:03.959914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:03.959925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:03.959942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.960133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.960152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.960176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:03.960358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2422 partition: 0 MaxSeqNo: 45 sessionId: src_id|d593c86-1728bb77-df0961e1-ebde4648_0
2025-10-01T14:15:03.960737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae15a68-fa244679-f93f1314-feb285b2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d593c86-1728bb77-df0961e1-ebde4648_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:03.963834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Write session: try to update token
2025-10-01T14:15:03.963852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:03.973971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:03.973992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:03.974002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.974037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:03.974049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:03.974253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:03.974452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:03.974634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:03.974818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:03.975048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:03.975088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:03.985631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId: src_id|d593c86-1728bb77-df0961e1-ebde4648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:03.988362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:03.988590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:03.988613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:03.988654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:03.988760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:03.997443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:03.997461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:03.997463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:03.997464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:03.997473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.997476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.997479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256667019083225:8369]
2025-10-01T14:15:03.997514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:03.997520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:03.997521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:03.997674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:03.998465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:03.998481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:03.998486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:04.013329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256673690964647:5192]
2025-10-01T14:15:04.013508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2421, pipe: [1:7556256673690964647:5192]
2025-10-01T14:15:04.147106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:04.155379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.155410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.155595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.155665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.155732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.155805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.155853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.155864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.155939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.156009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.156112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.156213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.156257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.156265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.156366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.156458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.156530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.156634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.156679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.156687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.156753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.156859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.156926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.156992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.157042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.157050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.157151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.157246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.157309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.157376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.157423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.157432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.157498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.157556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.157620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.157683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.157738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.157749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.157811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.157872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.157934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.158000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.158058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.158064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.158128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.158186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.158242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.158297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.158342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.158349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.158424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.158484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.158543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.158602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.158660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.158667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.158734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.158795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.158860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.158920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.158969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.158976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.159055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690964647:5192], now have 1 active actors on pipe
2025-10-01T14:15:04.159299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:04.159371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256673690964647:5192]
2025-10-01T14:15:04.159649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:04.159659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:04.159681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2422 reason: error at write: Disconnected sessionId: src_id|d593c86-1728bb77-df0961e1-ebde4648_0
2025-10-01T14:15:04.159893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2422 sessionId: src_id|d593c86-1728bb77-df0961e1-ebde4648_0 is DEAD
2025-10-01T14:15:04.160080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:04.160092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Write session will restart in 0.006822s
2025-10-01T14:15:04.160117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Write session: Do CDS request
2025-10-01T14:15:04.160123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:04.160212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:04.167923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.168029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:04.168047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2423
2025-10-01T14:15:04.168215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.168251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:04.168262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:04.168266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:04.168705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2423 sessionId:  describe result for acl check
2025-10-01T14:15:04.168740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:04.169032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:04.169039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:04.169045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256673690964747:4833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:04.169533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256673690964747:4833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:04.171558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256673690964747:4833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:04.175069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256673690964747:4833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:04.175084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256673690964747:4833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:04.175088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256673690964747:4833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:04.175096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:04.177578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:04.179503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:04.179658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:04.179667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:04.179676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:04.179733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:04.179771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256671314050815:8337]
2025-10-01T14:15:04.180274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:04.180551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:04.180592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:04.180881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:04.180930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.180935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.180936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.180937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.180938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.180939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.180940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.180942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.180943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.180944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.180945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.180946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.180947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.180948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.180953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.180962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.180966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.180978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.180982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.180986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.180990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.180993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.180997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.181001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.181004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.181008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.181011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.181015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.181020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.181027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.181033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.181039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.181047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.181051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.181055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.181060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.181064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.181069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.181076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.181082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.181086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.181094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.181098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.181103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.181111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.181116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.181120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.181126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.181134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.181138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.181142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.181146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.181154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.181159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.181163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.181171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.181208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:04.184542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:04.185410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:04.185420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:04.185422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:04.185426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:04.185431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2422 [2:7556256671314050815:8337]
2025-10-01T14:15:04.185446Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:04.185461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:04.185464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.185467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.185470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.185483Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:04.185488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:04.185493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:04.185531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.185536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.185537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.185539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:04.185541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:04.185585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:04.185591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.185597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.185602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.185611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:04.185626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690964653:2446], now have 1 active actors on pipe
2025-10-01T14:15:04.185635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.185637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.185638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.185644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:04.185654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:04.185654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:04.185657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:04.185658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:04.185665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:04.185667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:04.185673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965004:4833], now have 1 active actors on pipe
2025-10-01T14:15:04.185693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.185701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:04.185711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:04.185749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.185725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2422
2025-10-01T14:15:04.185756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.185773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:04.185780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.185784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.185785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:04.185792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.185801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:04.185810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.185798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2422
2025-10-01T14:15:04.185949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.185965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.185988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.186084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2423 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0
2025-10-01T14:15:04.186438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d593c86-1728bb77-df0961e1-ebde4648_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:04.189237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Write session: try to update token
2025-10-01T14:15:04.189251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:04.196339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:04.196357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:04.196368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.196415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:04.196418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:04.196624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:04.196811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:04.196957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:04.197153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:04.197432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:04.197480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:04.204995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId: src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:04.207577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:04.207781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.207806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.207846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:04.207962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:04.215022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:04.215047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:04.215050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:04.215053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:04.215065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.215070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.215074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256671314050810:8337]
2025-10-01T14:15:04.215126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:04.215126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:04.215132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:04.215136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:04.215138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.215140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:04.215292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:04.259642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256673690965031:5192]
2025-10-01T14:15:04.259890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2422, pipe: [1:7556256673690965031:5192]
2025-10-01T14:15:04.368532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:04.377518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.377553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.377732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.377802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.377872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.377945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.377986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.377992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.378062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.378147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.378211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.378272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.378319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.378323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.378501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.378583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.378649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.378723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.378770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.378778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.378855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.378926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.378999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.379070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.379117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.379128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.379200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.379261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.379359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.379470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.379528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.379531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.379605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.379670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.379731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.379798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.379863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.379867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.379945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.380006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.380075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.380149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.380505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.380508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.380607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.380674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.380742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.380814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.380861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.380866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.380943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.381007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.381066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.381134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.381198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.381201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.381278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:04.381341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:04.381409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:04.381471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:04.381534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:04.381537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:04.381614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965031:5192], now have 1 active actors on pipe
2025-10-01T14:15:04.383075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:04.383088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Write session will restart in 0.009595s
2025-10-01T14:15:04.383114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Write session: Do CDS request
2025-10-01T14:15:04.383119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:04.383091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:04.382458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:04.382476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:04.382563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2423 reason: error at write: Disconnected sessionId: src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0
2025-10-01T14:15:04.382700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256673690965031:5192]
2025-10-01T14:15:04.382725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:04.382774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2423 sessionId: src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0 is DEAD
2025-10-01T14:15:04.393928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.393980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:04.394000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2424
2025-10-01T14:15:04.394153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.394197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:04.394203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:04.394210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:04.394637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2424 sessionId:  describe result for acl check
2025-10-01T14:15:04.394673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:04.394675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:04.394677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:04.394682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256673690965073:4806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:04.395186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256673690965073:4806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:04.398401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256673690965073:4806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:04.402253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256673690965073:4806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:04.402269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256673690965073:4806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:04.402274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256673690965073:4806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:04.402285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:04.408488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:04.411916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:04.412157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:04.412168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:04.412179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:04.412229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:04.412272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256671314051076:8336]
2025-10-01T14:15:04.412852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:04.413186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:04.413227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:04.413502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:04.413550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.413551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.413552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.413553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.413554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.413555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.413556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.413557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.413558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.413559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.413560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.413561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.413561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.413562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.413567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.413575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.413579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.413582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.413584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.413587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.413591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.413593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.413596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.413599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.413602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.413605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.413608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.413610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.413616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.413623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.413628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.413633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.413637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.413641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.413644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.413648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.413652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.413656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.413660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.413665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.413669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.413673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.413676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.413680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.413684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.413688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.413692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.413696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.413700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.413704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.413710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.413714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.413717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.413721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.413725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.413729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.413760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:04.417660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:04.418581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:04.418594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:04.418597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:04.418600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:04.418608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2423 [2:7556256671314051076:8336]
2025-10-01T14:15:04.418625Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:04.418646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:04.418654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.418658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.418660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.418675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:04.418682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:04.418692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:04.418759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.418766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.418769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.418773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:04.418776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:04.418855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:04.418862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.418874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.418891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.418911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:04.418933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.418939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.418941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.418950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:04.418964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:04.418976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:04.418981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:04.419011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:04.419017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.419019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:04.419023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:04.419025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:04.419029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965314:4806], now have 1 active actors on pipe
2025-10-01T14:15:04.419032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965034:2446], now have 1 active actors on pipe
2025-10-01T14:15:04.419032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:04.419130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2423
2025-10-01T14:15:04.419135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2423
2025-10-01T14:15:04.419227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.419239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.419270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:04.419283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.419289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.419292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:04.419302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.419326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:04.419345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.419556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.419569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.419591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.419722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2424 partition: 0 MaxSeqNo: 45 sessionId: src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0
2025-10-01T14:15:04.420186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c776ab5-b62aed1f-533649f4-2e18d65f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:04.423267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Write session: try to update token
2025-10-01T14:15:04.423288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:04.438687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId: src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:04.441277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:04.440705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:04.440732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:04.440736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:04.440739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:04.440750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.440755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.440763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256671314051070:8336]
2025-10-01T14:15:04.440824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:04.440831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.440834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:04.441044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:04.441421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:04.441428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:04.441432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:04.482415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256673690965415:5192]
2025-10-01T14:15:04.483228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2423, pipe: [1:7556256673690965415:5192]
2025-10-01T14:15:04.599289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:04.599575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.599584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.599628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965415:5192], now have 1 active actors on pipe
2025-10-01T14:15:04.599843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:04.599808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:04.599861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:04.599864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:04.599903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256673690965415:5192]
2025-10-01T14:15:04.599932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2424 reason: error at write: Disconnected sessionId: src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0
2025-10-01T14:15:04.600115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2424 sessionId: src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0 is DEAD
2025-10-01T14:15:04.600248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:04.600261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Write session will restart in 0.006401s
2025-10-01T14:15:04.600292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Write session: Do CDS request
2025-10-01T14:15:04.600299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:04.607886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.607972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:04.607991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2425
2025-10-01T14:15:04.608101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.608136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:04.608147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:04.608155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:04.608613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2425 sessionId:  describe result for acl check
2025-10-01T14:15:04.608654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:04.608661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:04.608663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:04.608669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256673690965440:4789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:04.609232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256673690965440:4789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:04.611251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256673690965440:4789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:04.614539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256673690965440:4789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:04.614556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256673690965440:4789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:04.614562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256673690965440:4789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:04.614571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:04.624301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:04.626486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:04.626685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:04.626695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:04.626706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:04.626755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:04.626797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256671314051348:8330]
2025-10-01T14:15:04.627373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:04.627675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:04.627734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:04.628037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:04.628119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.628127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.628128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.628129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.628130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.628131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.628132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.628133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.628134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.628135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.628136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.628136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.628137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.628138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.628143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.628152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.628156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.628159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.628162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.628165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.628169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.628172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.628176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.628179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.628183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.628186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.628189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.628193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.628200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.628206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.628212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.628222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.628231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.628235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.628245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.628254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.628258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.628262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.628266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.628271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.628280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.628288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.628293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.628300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.628305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.628309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.628313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.628317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.628321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.628326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.628330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.628335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.628339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.628344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.628348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.628352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.628387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:04.632065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:04.632761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:04.632780Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:04.632783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:04.632786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:04.632793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2424 [2:7556256671314051348:8330]
2025-10-01T14:15:04.632812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:04.632834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:04.632837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.632840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.632842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.632857Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:04.632871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:04.632877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:04.632929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.632936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.632938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.632941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:04.632943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:04.633004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:04.633010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.633021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.633034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.633052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:04.633072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965529:4789], now have 1 active actors on pipe
2025-10-01T14:15:04.633078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965425:2446], now have 1 active actors on pipe
2025-10-01T14:15:04.633084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.633088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.633090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.633104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:04.633114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:04.633119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:04.633122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:04.633123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:04.633130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:04.633095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2424
2025-10-01T14:15:04.633133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:04.633098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2424
2025-10-01T14:15:04.633167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.633176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.633193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.633203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:04.633210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:04.633226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:04.633237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.633241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.633243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:04.633251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.633262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:04.633288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.633403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.633411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.633425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.633504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2425 partition: 0 MaxSeqNo: 45 sessionId: src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0
2025-10-01T14:15:04.633826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a077e29f-fe4c6997-d5d95f1b-7c616bd1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:04.636361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Write session: try to update token
2025-10-01T14:15:04.636378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:04.650201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId: src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:04.652800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:04.653841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.653870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.653893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:04.653897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:04.653900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:04.653902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:04.653911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.653916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.653921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256671314051343:8330]
2025-10-01T14:15:04.653960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:04.653975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:04.653978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:04.653978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:04.653985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.653987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:04.654127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:04.699928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256673690965811:5192]
2025-10-01T14:15:04.700171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2424, pipe: [1:7556256673690965811:5192]
2025-10-01T14:15:04.803407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:04.803977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:04.804020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965811:5192], now have 1 active actors on pipe
2025-10-01T14:15:04.804082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:04.804233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256673690965811:5192]
2025-10-01T14:15:04.804283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:04.815243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:04.815259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:04.815284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2425 reason: error at write: Disconnected sessionId: src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0
2025-10-01T14:15:04.815502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2425 sessionId: src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0 is DEAD
2025-10-01T14:15:04.815573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:04.815583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Write session will restart in 0.007280s
2025-10-01T14:15:04.815609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Write session: Do CDS request
2025-10-01T14:15:04.815616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:04.823961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.824647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:04.824666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2426
2025-10-01T14:15:04.827146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:04.827205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:04.827216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:04.827221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:04.827630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2426 sessionId:  describe result for acl check
2025-10-01T14:15:04.827661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:04.827665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:04.827667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:04.827671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256673690966045:4763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:04.828082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256673690966045:4763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:04.830647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256673690966045:4763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:04.834363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256673690966045:4763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:04.834397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256673690966045:4763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:04.834400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256673690966045:4763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:04.834409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:04.836599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:04.839144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:04.839397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:04.839407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:04.839418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:04.839468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:04.839512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256671314051620:8325]
2025-10-01T14:15:04.840136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:04.840478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:04.840539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:04.840984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:04.841064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.841069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.841071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.841072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.841073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.841075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.841076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.841077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.841078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.841080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.841081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.841082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.841083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.841084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.841091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.841100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.841104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.841108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.841112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.841116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.841121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.841125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.841129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.841133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.841138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.841141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.841146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.841150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.841157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.841165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:04.841171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.841177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:04.841186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.841191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:04.841197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.841202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:04.841207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.841212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:04.841217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.841229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:04.841237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.841247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:04.841255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.841264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:04.841273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.841278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:04.841283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.841289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.841294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.841299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.841308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.841312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.841317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.841321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:04.841326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.841332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:04.841376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:04.847896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:04.848992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:04.849008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:04.849010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:04.849014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:04.849020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2425 [2:7556256671314051620:8325]
2025-10-01T14:15:04.849035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:04.849053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:04.849059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.849062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.849065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.849084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:04.849094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:04.849101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:04.849172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.849180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.849182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.849186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:04.849188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:04.849260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:04.849269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.849283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:04.849295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:04.849312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:04.849335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690965838:2446], now have 1 active actors on pipe
2025-10-01T14:15:04.849343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690966195:4763], now have 1 active actors on pipe
2025-10-01T14:15:04.849351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.849358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.849360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.849376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:04.849392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:04.849406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:04.849415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:04.849444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:04.849455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:04.849456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.849458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:04.849458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:04.849465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:04.849446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2425
2025-10-01T14:15:04.849499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2425
2025-10-01T14:15:04.849635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.849650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.849677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:04.849690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:04.849694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:04.849701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:04.849712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:04.849725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:04.849747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.849916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:04.849930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:04.849956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:04.850054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2426 partition: 0 MaxSeqNo: 45 sessionId: src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0
2025-10-01T14:15:04.850498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6fd82f-4c90df89-dfb37235-1633c7f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:04.853658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Write session: try to update token
2025-10-01T14:15:04.853680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:04.871406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId: src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:04.872621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:04.872640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:04.872643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:04.872645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:04.872655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.872660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.872664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256671314051615:8325]
2025-10-01T14:15:04.872715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:04.872726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:04.872728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:04.872830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:04.872842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:04.872845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:04.872866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:04.874060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:04.904294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256673690966218:5192]
2025-10-01T14:15:04.904707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2425, pipe: [1:7556256673690966218:5192]
2025-10-01T14:15:05.020535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:05.021034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.021051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.021094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256673690966218:5192], now have 1 active actors on pipe
2025-10-01T14:15:05.021315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:05.021320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256673690966218:5192]
2025-10-01T14:15:05.021334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:05.021358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:05.021427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2426 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0
2025-10-01T14:15:05.021626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2426 sessionId: src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0 is DEAD
2025-10-01T14:15:05.021770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:05.021781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Write session will restart in 0.007666s
2025-10-01T14:15:05.021806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Write session: Do CDS request
2025-10-01T14:15:05.021813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:05.030882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.030987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:05.031015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2427
2025-10-01T14:15:05.031122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.031156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:05.031166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:05.031170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:05.031551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2427 sessionId:  describe result for acl check
2025-10-01T14:15:05.031586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:05.031593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:05.031597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:05.031602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256677985933668:4729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:05.032126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256677985933668:4729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:05.034168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256677985933668:4729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:05.037154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256677985933668:4729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:05.037169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256677985933668:4729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:05.037172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256677985933668:4729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:05.037181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:05.039051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:05.041195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:05.041441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:05.041454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:05.041466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:05.041525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:05.041570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256675609019178:8322]
2025-10-01T14:15:05.042153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:05.042460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:05.042505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:05.042786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:05.042842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.042847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.042849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.042850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.042851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.042852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.042853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.042854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.042855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.042856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.042857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.042858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.042859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.042860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.042865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.042873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.042876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.042880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.042883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.042886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.042889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.042893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.042897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.042902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.042905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.042908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.042911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.042914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.042922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.042929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.042935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.042939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.042943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.042947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.042950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.042955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.042959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.042963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.042966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.042971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.042975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.042979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.042982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.042986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.042991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.042995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.042999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.043004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.043008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.043012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.043015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.043019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.043023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.043027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.043030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.043035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.043070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:05.046660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:05.047739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:05.047753Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:05.047755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:05.047758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:05.047763Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2426 [2:7556256675609019178:8322]
2025-10-01T14:15:05.047775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:05.047789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:05.047795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.047797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.047799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.047812Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:05.047816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:05.047824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:05.047870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.047875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.047876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.047879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:05.047882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:05.047942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:05.047950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.047961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.047970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.047984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:05.048005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.048011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.048012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.048023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:05.048038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985933533:2446], now have 1 active actors on pipe
2025-10-01T14:15:05.048040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:05.048043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:05.048044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985933900:4729], now have 1 active actors on pipe
2025-10-01T14:15:05.048045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:05.048050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:05.048061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:05.048064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:05.048100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.048110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:05.048120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:05.048115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2426
2025-10-01T14:15:05.048128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2426
2025-10-01T14:15:05.048167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.048177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.048207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:05.048217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.048225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.048227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:05.048241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.048252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:05.048267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.050477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.050494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.050526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.050661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2427 partition: 0 MaxSeqNo: 45 sessionId: src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0
2025-10-01T14:15:05.051000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fd14d7-47fe0e04-16d94cc3-f58f2f20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:05.053824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Write session: try to update token
2025-10-01T14:15:05.053838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:05.059534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:05.059557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:05.059566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.059606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:05.059614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:05.059772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:05.059909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:05.060049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:05.060215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:05.060428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:05.060466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:05.068236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId: src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:05.071060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:05.071260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.071286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.071325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:05.071387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:05.077789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:05.077814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:05.077816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:05.077818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:05.077829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.077833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.077837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256675609019173:8322]
2025-10-01T14:15:05.077881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:05.077884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:05.077892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.077895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:05.077896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:05.077900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:05.078036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:05.121312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256677985933916:5192]
2025-10-01T14:15:05.121574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2426, pipe: [1:7556256677985933916:5192]
2025-10-01T14:15:05.217712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:05.224987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.225015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.225151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.225206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.225262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.225314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.225484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.225496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.225555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.225610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.225667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.225750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.225790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.225796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.225857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.225914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.225972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.226029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.226069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.226074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.226136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.226196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.226257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.226313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.226354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.226359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.226442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.226500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.226560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.226618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.226661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.226667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.226725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.226778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.226838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.226898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.226942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.226949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.227023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.227088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.227145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.227204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.227298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.227306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.227362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.227416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.227473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.227531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.227570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.227575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.227638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.227696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.227753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.227810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.227850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.227855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.227915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:05.227971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:05.228027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:05.228079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:05.228119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:05.228124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:05.228182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985933916:5192], now have 1 active actors on pipe
2025-10-01T14:15:05.228478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256677985933916:5192]
2025-10-01T14:15:05.228481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:05.228519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:05.228524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:05.228560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2427 reason: error at write: Disconnected sessionId: src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0
2025-10-01T14:15:05.228717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2427 sessionId: src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0 is DEAD
2025-10-01T14:15:05.228846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:05.228857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Write session will restart in 0.008803s
2025-10-01T14:15:05.228895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Write session: Do CDS request
2025-10-01T14:15:05.228901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:05.229051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:05.238845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.238970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:05.238988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2428
2025-10-01T14:15:05.239090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.239121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:05.239130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:05.239133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:05.239539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2428 sessionId:  describe result for acl check
2025-10-01T14:15:05.239577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:05.239583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:05.239584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:05.239590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256677985934127:4718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:05.240115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256677985934127:4718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:05.242300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256677985934127:4718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:05.245026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256677985934127:4718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:05.245044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256677985934127:4718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:05.245048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256677985934127:4718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:05.245055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:05.245408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:05.247646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:05.247873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:05.247886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:05.247899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:05.247966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:05.248008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256675609019473:8303]
2025-10-01T14:15:05.248606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:05.248969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:05.249031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:05.249358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:05.249427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.249434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.249436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.249437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.249438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.249440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.249441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.249442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.249444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.249445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.249446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.249447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.249448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.249449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.249455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.249466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.249470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.249474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.249477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.249483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.249487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.249495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.249499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.249506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.249510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.249518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.249522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.249531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.249540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.249552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.249563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.249572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.249580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.249590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.249599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.249609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.249618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.249627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.249637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.249646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.249654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.249659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.249667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.249676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.249685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.249694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.249699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.249706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.249717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.249726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.249734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.249739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.249746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.249755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.249759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.249764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.249801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:05.253761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:05.254668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:05.254686Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:05.254689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:05.254693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:05.254699Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2427 [2:7556256675609019473:8303]
2025-10-01T14:15:05.254717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:05.254735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:05.254745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.254750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.254752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.254771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:05.254777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:05.254787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:05.254861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.254869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.254871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.254874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:05.254877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:05.254948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:05.254956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.254968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.254979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.254998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:05.255024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985934295:4718], now have 1 active actors on pipe
2025-10-01T14:15:05.255028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985933925:2446], now have 1 active actors on pipe
2025-10-01T14:15:05.255036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.255039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.255041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.255054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:05.255071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:05.255076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:05.255080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:05.255082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:05.255091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:05.255094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:05.255111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2427
2025-10-01T14:15:05.255133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.255116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2427
2025-10-01T14:15:05.255143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:05.255145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:05.255177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.255186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.255220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:05.255232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.255240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.255243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:05.255252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.255267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:05.255292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.255425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.255435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.255520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2428 partition: 0 MaxSeqNo: 45 sessionId: src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0
2025-10-01T14:15:05.255450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.255879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88960a9-21d0ed3e-20fe9f7e-14aa3cd3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:05.258778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Write session: try to update token
2025-10-01T14:15:05.258796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:05.275372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId: src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:05.276125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:05.276147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:05.276150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:05.276151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:05.276160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.276164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.276167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256675609019468:8303]
2025-10-01T14:15:05.276210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:05.276217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:05.276222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:05.276224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.276226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:05.276227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:05.276368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:05.277930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:05.328681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256677985934307:5192]
2025-10-01T14:15:05.328914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2427, pipe: [1:7556256677985934307:5192]
2025-10-01T14:15:05.417457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:05.418007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.418021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.418058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985934307:5192], now have 1 active actors on pipe
2025-10-01T14:15:05.418258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:05.418257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:05.418265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256677985934307:5192]
2025-10-01T14:15:05.418274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:05.418284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:05.418501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2428 reason: error at write: Disconnected sessionId: src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0
2025-10-01T14:15:05.418683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2428 sessionId: src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0 is DEAD
2025-10-01T14:15:05.418823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:05.418833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Write session will restart in 0.005010s
2025-10-01T14:15:05.418860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Write session: Do CDS request
2025-10-01T14:15:05.418865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:05.424874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.424950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:05.424972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2429
2025-10-01T14:15:05.425100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.425133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:05.425142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:05.425146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:05.425530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2429 sessionId:  describe result for acl check
2025-10-01T14:15:05.425560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:05.425566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:05.425567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:05.425573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256677985934343:4722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:05.426060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256677985934343:4722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:05.428652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256677985934343:4722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:05.431430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256677985934343:4722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:05.431445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256677985934343:4722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:05.431448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256677985934343:4722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:05.431456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:05.435918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:05.437980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:05.438203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:05.438215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:05.438227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:05.438276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:05.438307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256675609019737:8300]
2025-10-01T14:15:05.438894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:05.439143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:05.439187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:05.439495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:05.439567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.439574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.439575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.439576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.439577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.439578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.439580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.439581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.439582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.439583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.439584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.439585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.439586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.439587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.439593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.439603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.439606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.439610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.439613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.439616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.439619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.439624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.439627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.439631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.439639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.439643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.439650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.439653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.439664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.439676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.439686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.439691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.439697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.439702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.439706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.439715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.439720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.439729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.439737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.439741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.439749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.439755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.439758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.439761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.439767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.439770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.439772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.439776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.439779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.439782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.439784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.439787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.439789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.439792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.439794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.439797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.439820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:05.443651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:05.444290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:05.444307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:05.444308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:05.444312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:05.444318Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2428 [2:7556256675609019737:8300]
2025-10-01T14:15:05.444335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:05.444359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:05.444366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.444370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.444373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.444392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:05.444404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:05.444409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:05.444457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.444463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.444465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.444468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:05.444470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:05.444526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:05.444531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.444539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.444556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.444568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:05.444582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985934310:2446], now have 1 active actors on pipe
2025-10-01T14:15:05.444592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.444593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.444595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.444604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:05.444611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985934598:4722], now have 1 active actors on pipe
2025-10-01T14:15:05.444614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:05.444616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:05.444618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:05.444621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:05.444629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:05.444631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:05.444655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2428
2025-10-01T14:15:05.444662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2428
2025-10-01T14:15:05.444665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.444670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:05.444687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:05.444706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.444709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.444731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:05.444741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.444744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.444745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:05.444753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.444760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:05.444770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.444916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.444924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.444937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.445174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2429 partition: 0 MaxSeqNo: 45 sessionId: src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0
2025-10-01T14:15:05.445538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20635509-a3a56e3b-fbdfb64-5ddd744b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:05.448302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Write session: try to update token
2025-10-01T14:15:05.448319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:05.462614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId: src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:05.465130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:05.465966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.465993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.466015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:05.466017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:05.466020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:05.466021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:05.466030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.466034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.466038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256675609019732:8300]
2025-10-01T14:15:05.466070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:05.466081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:05.466084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:05.466092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:05.466098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.466100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:05.466225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:05.518652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256677985934697:5192]
2025-10-01T14:15:05.518907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2428, pipe: [1:7556256677985934697:5192]
2025-10-01T14:15:05.620293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:05.620568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:05.620624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985934697:5192], now have 1 active actors on pipe
2025-10-01T14:15:05.620717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:05.620764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:05.620815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:05.620823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:05.620826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256677985934697:5192]
2025-10-01T14:15:05.620905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2429 reason: error at write: Disconnected sessionId: src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0
2025-10-01T14:15:05.621097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2429 sessionId: src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0 is DEAD
2025-10-01T14:15:05.621215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:05.621223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Write session will restart in 0.008553s
2025-10-01T14:15:05.621241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Write session: Do CDS request
2025-10-01T14:15:05.621248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:05.630835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.630932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:05.630950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2430
2025-10-01T14:15:05.631057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.631087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:05.631094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:05.631097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:05.631576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2430 sessionId:  describe result for acl check
2025-10-01T14:15:05.631615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:05.631622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:05.631624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:05.631630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256677985934890:4700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:05.632140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256677985934890:4700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:05.634573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256677985934890:4700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:05.636999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256677985934890:4700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:05.637012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256677985934890:4700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:05.637015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256677985934890:4700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:05.637023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:05.637611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:05.639584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:05.639798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:05.639806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:05.639814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:05.639850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:05.639889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256675609020014:8299]
2025-10-01T14:15:05.640313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:05.640635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:05.640684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:05.640933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:05.640986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.640992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.640993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.640993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.640994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.640995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.640996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.640996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.640997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.640998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.640999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.640999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.641000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.641001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.641004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.641010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.641012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.641016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.641019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.641023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.641027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.641030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.641033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.641037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.641040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.641044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.641046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.641050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.641057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.641065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.641071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.641075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.641079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.641084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.641089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.641093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.641098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.641103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.641106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.641110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.641115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.641120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.641123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.641128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.641132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.641137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.641142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.641146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.641150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.641162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.641170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.641180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.641187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.641190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.641193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.641201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.641246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:05.645037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:05.645988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:05.646009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:05.646013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:05.646017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:05.646025Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2429 [2:7556256675609020014:8299]
2025-10-01T14:15:05.646042Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:05.646061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:05.646069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.646072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.646074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.646092Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:05.646102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:05.646108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:05.646570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.646580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.646582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.646586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:05.646588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:05.646667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:05.646676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.646689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.646698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.646712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:05.646730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985935081:4700], now have 1 active actors on pipe
2025-10-01T14:15:05.646738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985934706:2446], now have 1 active actors on pipe
2025-10-01T14:15:05.646746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.646752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.646754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.646766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:05.646782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:05.646787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:05.646793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:05.646796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:05.646801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:05.646804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:05.646803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2429
2025-10-01T14:15:05.646804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2429
2025-10-01T14:15:05.646847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.646863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:05.646869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:05.646885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.646893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.646946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2024cef6-5b462ec8-51c937be-9738378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:05.646959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.646967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.646970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:05.646978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.646988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:05.647014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.647221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.647230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.647245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.647321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2430 partition: 0 MaxSeqNo: 45 sessionId: src_id|2024cef6-5b462ec8-51c937be-9738378_0
2025-10-01T14:15:05.647745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e406b-84bcdea8-65ea76b6-f63cdb5c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2024cef6-5b462ec8-51c937be-9738378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:05.650718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Write session: try to update token
2025-10-01T14:15:05.650736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:05.668769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:05.668800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:05.668805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:05.668808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:05.668824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.668831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.668838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256675609020009:8299]
2025-10-01T14:15:05.668887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:05.668901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:05.668905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:05.668909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:05.668919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.668933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:05.669212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:05.672132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId: src_id|2024cef6-5b462ec8-51c937be-9738378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:05.674882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:05.720865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256677985935095:5192]
2025-10-01T14:15:05.721109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2429, pipe: [1:7556256677985935095:5192]
2025-10-01T14:15:05.809151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:05.809534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.809549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.809588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985935095:5192], now have 1 active actors on pipe
2025-10-01T14:15:05.809767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:05.809797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:05.809784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:05.809841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2430 reason: error at write: Disconnected sessionId: src_id|2024cef6-5b462ec8-51c937be-9738378_0
2025-10-01T14:15:05.810047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2430 sessionId: src_id|2024cef6-5b462ec8-51c937be-9738378_0 is DEAD
2025-10-01T14:15:05.810162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:05.810168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Write session will restart in 0.005808s
2025-10-01T14:15:05.810186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Write session: Do CDS request
2025-10-01T14:15:05.810191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:05.810242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256677985935095:5192]
2025-10-01T14:15:05.810266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:05.816880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.816964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:05.816982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2431
2025-10-01T14:15:05.817140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:05.817169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:05.817173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:05.817176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:05.817556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2431 sessionId:  describe result for acl check
2025-10-01T14:15:05.817589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:05.817598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:05.817600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:05.817605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256677985935165:4682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:05.818082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256677985935165:4682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:05.819937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256677985935165:4682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:05.822589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256677985935165:4682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:05.822609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256677985935165:4682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:05.822613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256677985935165:4682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:05.822620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:05.827169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:05.829490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:05.829693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:05.829704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:05.829715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:05.829767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:05.829804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256675609020284:8297]
2025-10-01T14:15:05.830310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:05.830630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:05.830673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:05.830971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:05.831013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.831017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.831018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.831019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.831020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.831020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.831021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.831021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.831023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.831023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.831024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.831024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.831025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.831025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.831029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.831034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.831037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.831039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.831041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.831043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.831045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.831047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.831049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.831052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.831054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.831056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.831058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.831060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.831064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.831069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:05.831072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.831075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:05.831078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.831081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:05.831083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.831087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:05.831090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.831092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:05.831094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.831097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:05.831100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.831103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:05.831105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.831108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:05.831111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.831114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:05.831116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.831119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.831121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.831124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.831127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.831129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.831132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.831136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:05.831138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.831141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:05.831161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:05.834612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:05.835338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:05.835352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:05.835354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:05.835357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:05.835362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2430 [2:7556256675609020284:8297]
2025-10-01T14:15:05.835372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:05.835384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:05.835386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.835388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.835390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.835400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:05.835403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:05.835408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:05.835447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.835452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.835454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.835456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:05.835458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:05.835523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:05.835530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.835538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:05.835548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:05.835556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:05.835572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.835577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.835578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.835585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:05.835595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985935113:2446], now have 1 active actors on pipe
2025-10-01T14:15:05.835594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:05.835598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:05.835600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:05.835601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985935396:4682], now have 1 active actors on pipe
2025-10-01T14:15:05.835607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:05.835614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:05.835616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:05.835634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.835642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:05.835648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:05.835673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2430
2025-10-01T14:15:05.835725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2430
2025-10-01T14:15:05.835762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.835771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.835789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:05.835796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:05.835799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:05.835801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:05.835807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:05.835817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:05.835826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.836017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.836027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.836039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:05.836118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2431 partition: 0 MaxSeqNo: 45 sessionId: src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0
2025-10-01T14:15:05.836463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2024cef6-5b462ec8-51c937be-9738378_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:05.839379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Write session: try to update token
2025-10-01T14:15:05.839399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:05.856124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId: src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:05.858563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:05.859156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:05.859184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:05.859207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:05.859211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:05.859214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:05.859215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:05.859224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.859229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.859233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256675609020279:8297]
2025-10-01T14:15:05.859268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:05.859285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:05.859289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:05.859292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:05.859300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:05.859303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:05.859425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:05.910318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256677985935509:5192]
2025-10-01T14:15:05.910644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2430, pipe: [1:7556256677985935509:5192]
2025-10-01T14:15:06.012905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:06.013309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:06.013938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:06.013368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256677985935509:5192], now have 1 active actors on pipe
2025-10-01T14:15:06.014453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:06.014467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Write session will restart in 0.005179s
2025-10-01T14:15:06.014031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:06.014041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:06.014103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2431 reason: error at write: Disconnected sessionId: src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0
2025-10-01T14:15:06.014268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2431 sessionId: src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0 is DEAD
2025-10-01T14:15:06.014427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:06.014438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256677985935509:5192]
2025-10-01T14:15:06.014497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Write session: Do CDS request
2025-10-01T14:15:06.014506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:06.020926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.021001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:06.021020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2432
2025-10-01T14:15:06.021138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.021176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:06.021190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:06.021193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:06.021604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2432 sessionId:  describe result for acl check
2025-10-01T14:15:06.021638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:06.021645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:06.021646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:06.021651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256682280902839:4669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:06.022207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256682280902839:4669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:06.024714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256682280902839:4669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:06.029008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256682280902839:4669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:06.029040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256682280902839:4669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:06.029043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256682280902839:4669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:06.029051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:06.041855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:06.052980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:06.053513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:06.053529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:06.053544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:06.053643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:06.053690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256679903987854:8285]
2025-10-01T14:15:06.054119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:06.054472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:06.054518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:06.054774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:06.054822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.054828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.054829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.054829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.054830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.054831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.054832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.054833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.054834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.054835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.054836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.054836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.054837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.054838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.054841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.054848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.054851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.054853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.054856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.054858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.054860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.054863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.054865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.054868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.054870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.054872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.054875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.054877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.054882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.054887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.054892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.054895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.054901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.054904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.054907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.054911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.054914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.054917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.054920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.054925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.054930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.054935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.054940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.054944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.054949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.054954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.054959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.054965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.054969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.054973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.054978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.054984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.054991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.054996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.055001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.055007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.055048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:06.060253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:06.060945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:06.060962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:06.060966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:06.060970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:06.060979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2431 [2:7556256679903987854:8285]
2025-10-01T14:15:06.060995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:06.061017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:06.061020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.061030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.061032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.061052Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:06.061062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:06.061070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:06.061158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.061165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.061168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.061172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:06.061175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:06.061240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:06.061247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.062415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.062434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.062452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:06.062474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.062477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.062480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.062491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:06.062509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:06.062524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:06.062527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:06.062577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.062580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:06.062857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:06.062861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:06.062864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:06.062870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:06.062963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280902812:2446], now have 1 active actors on pipe
2025-10-01T14:15:06.063886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903005:4669], now have 1 active actors on pipe
2025-10-01T14:15:06.064250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2431
2025-10-01T14:15:06.064315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2431
2025-10-01T14:15:06.064497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.064514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.064554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:06.064571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.064576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.064579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:06.064591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.064611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:06.064634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.071061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.071084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.071119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.071287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2432 partition: 0 MaxSeqNo: 45 sessionId: src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0
2025-10-01T14:15:06.072646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45e8f3b-c05bd564-f9e2a43-6d956fca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:06.075983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Write session: try to update token
2025-10-01T14:15:06.076006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:06.104401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId: src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:06.104327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:06.104350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:06.104353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:06.104356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:06.104369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.104374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.104377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256679903987849:8285]
2025-10-01T14:15:06.104425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:06.104432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.104435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:06.104607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:06.104973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:06.104983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:06.104988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:06.107264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:06.111488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256682280903210:5192]
2025-10-01T14:15:06.111902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2431, pipe: [1:7556256682280903210:5192]
2025-10-01T14:15:06.275980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:06.276374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.276391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.276413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903210:5192], now have 1 active actors on pipe
2025-10-01T14:15:06.276658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:06.276946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:06.277029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0
2025-10-01T14:15:06.277044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256682280903210:5192]
2025-10-01T14:15:06.277070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:06.277241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2432 sessionId: src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0 is DEAD
2025-10-01T14:15:06.277566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:06.277575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Write session will restart in 0.005398s
2025-10-01T14:15:06.277616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Write session: Do CDS request
2025-10-01T14:15:06.277624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:06.284581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.284942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:06.284962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2433
2025-10-01T14:15:06.285198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.285236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:06.285248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:06.285252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:06.285707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2433 sessionId:  describe result for acl check
2025-10-01T14:15:06.285745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:06.285754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:06.285756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:06.285761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256682280903250:4651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:06.286390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256682280903250:4651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:06.288572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256682280903250:4651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:06.292144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256682280903250:4651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:06.292162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256682280903250:4651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:06.292165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256682280903250:4651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:06.292173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:06.306047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:06.308256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:06.308699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:06.308712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:06.308725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:06.308790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:06.308837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256679903988153:8271]
2025-10-01T14:15:06.309520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:06.309870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:06.309912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:06.310220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:06.310292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.310298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.310300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.310301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.310302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.310303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.310304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.310305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.310306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.310307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.310309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.310310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.310311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.310312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.310317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.310328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.310331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.310335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.310339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.310342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.310346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.310350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.310353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.310357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.310361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.310364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.310368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.310387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.310395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.310403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.310409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.310414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.310418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.310423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.310428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.310433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.310438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.310443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.310447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.310452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.310457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.310462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.310471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.310476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.310486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.310495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.310500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.310509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.310516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.310521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.310525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.310530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.310534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.310543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.310547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.310556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.310600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:06.316687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:06.317664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:06.317684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:06.317687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:06.317690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:06.317697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2432 [2:7556256679903988153:8271]
2025-10-01T14:15:06.317717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:06.317742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:06.317749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.317754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.317761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.317778Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:06.317789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:06.317796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:06.317858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.317865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.317867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.317870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:06.317873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:06.317944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:06.317951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.317962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.317973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.317988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:06.318007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903217:2446], now have 1 active actors on pipe
2025-10-01T14:15:06.318015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903449:4651], now have 1 active actors on pipe
2025-10-01T14:15:06.318022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.318030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.318032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.318046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:06.318060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:06.318075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:06.318079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:06.318075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2432
2025-10-01T14:15:06.318127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2432
2025-10-01T14:15:06.318124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.318131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:06.318173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:06.318185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:06.318187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:06.318194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:06.318287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.318296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.318322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5baea5d-1b0f0716-30655dc-514852bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:06.318330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.318334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.318337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:06.318346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.318359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:06.318387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.318553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.318560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.318575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.318698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2433 partition: 0 MaxSeqNo: 45 sessionId: src_id|b5baea5d-1b0f0716-30655dc-514852bb_0
2025-10-01T14:15:06.319073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87559501-c7b2e1c4-74d79fad-70ef3f41_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b5baea5d-1b0f0716-30655dc-514852bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:06.322115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Write session: try to update token
2025-10-01T14:15:06.322137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:06.340472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:06.340498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:06.340501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:06.340503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:06.340514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.340521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.340526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256679903988148:8271]
2025-10-01T14:15:06.340596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:06.340608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.340610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:06.340778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:06.341716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:06.341730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:06.341734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:06.348363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId: src_id|b5baea5d-1b0f0716-30655dc-514852bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:06.351207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:06.377249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256682280903606:5192]
2025-10-01T14:15:06.377472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2432, pipe: [1:7556256682280903606:5192]
2025-10-01T14:15:06.479096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:06.479544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.479563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.479585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903606:5192], now have 1 active actors on pipe
2025-10-01T14:15:06.479766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:06.479774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:06.479781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:06.479798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:06.479820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256682280903606:5192]
2025-10-01T14:15:06.479833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2433 reason: error at write: Disconnected sessionId: src_id|b5baea5d-1b0f0716-30655dc-514852bb_0
2025-10-01T14:15:06.479984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2433 sessionId: src_id|b5baea5d-1b0f0716-30655dc-514852bb_0 is DEAD
2025-10-01T14:15:06.480152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:06.480163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Write session will restart in 0.006453s
2025-10-01T14:15:06.480197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Write session: Do CDS request
2025-10-01T14:15:06.480203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:06.487996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.488112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:06.488131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2434
2025-10-01T14:15:06.488258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.488291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:06.488301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:06.488306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:06.488652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2434 sessionId:  describe result for acl check
2025-10-01T14:15:06.488680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:06.488688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:06.488689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:06.488692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256682280903680:4637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:06.489196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256682280903680:4637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:06.491744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256682280903680:4637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:06.494353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256682280903680:4637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:06.494388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256682280903680:4637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:06.494391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256682280903680:4637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:06.494399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:06.501004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:06.503516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:06.503759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:06.503769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:06.503782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:06.503843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:06.503887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256679903988424:8263]
2025-10-01T14:15:06.504488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:06.504826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:06.504877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:06.505182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:06.505242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.505247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.505248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.505249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.505250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.505250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.505251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.505252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.505253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.505253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.505254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.505255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.505255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.505256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.505259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.505274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.505276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.505278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.505280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.505283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.505285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.505287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.505289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.505292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.505294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.505296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.505298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.505300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.505306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.505310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.505315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.505318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.505321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.505324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.505327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.505329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.505332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.505335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.505338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.505341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.505344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.505346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.505349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.505351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.505355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.505358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.505361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.505364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.505367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.505369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.505371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.505374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.505376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.505379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.505382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.505384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.505409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:06.510490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:06.511386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:06.511400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:06.511402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:06.511404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:06.511409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2433 [2:7556256679903988424:8263]
2025-10-01T14:15:06.511421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:06.511435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:06.511440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.511443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.511444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.511456Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:06.511461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:06.511466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:06.511518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.511524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.511525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.511528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:06.511530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:06.511586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:06.511592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.511602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.511614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.511631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:06.511653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903608:2446], now have 1 active actors on pipe
2025-10-01T14:15:06.511661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280903903:4637], now have 1 active actors on pipe
2025-10-01T14:15:06.511668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.511674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.511677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.511692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:06.511704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:06.511715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:06.511717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:06.511721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:06.511725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:06.511726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:06.511723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2433
2025-10-01T14:15:06.511725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2433
2025-10-01T14:15:06.511757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.511764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:06.511767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:06.511784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.511790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.511834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:06.511839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.511842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.511844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:06.511849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.511857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:06.511873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.512036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.512040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.512054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.512123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2434 partition: 0 MaxSeqNo: 45 sessionId: src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0
2025-10-01T14:15:06.512492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5baea5d-1b0f0716-30655dc-514852bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:06.515516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Write session: try to update token
2025-10-01T14:15:06.515535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:06.528239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:06.528259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:06.528269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.528320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:06.528325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:06.528502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:06.528652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:06.528781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:06.528913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:06.529101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:06.529135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:06.531606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId: src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:06.534009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:06.534565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.534584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.534611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:06.534689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:06.542309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:06.542331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:06.542333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:06.542335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:06.542345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.542348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.542351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256679903988419:8263]
2025-10-01T14:15:06.542413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:06.542415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:06.542419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:06.542422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:06.542424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.542427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:06.542566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:06.581230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256682280904004:5192]
2025-10-01T14:15:06.581559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2433, pipe: [1:7556256682280904004:5192]
2025-10-01T14:15:06.688849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:06.696169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.696196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.696327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.696382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.696435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.696489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.696534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.696556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.696626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.696681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.696743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.697052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.697096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.697102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.697166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.697229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.697309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.697379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.697423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.697430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.697494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.697559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.697617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.697697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.697749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.697756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.697824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.697886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.697946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.698015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.698066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.698073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.698159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.698219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.698274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.698333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.698411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.698419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.698482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.698531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.698591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.698653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.698694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.698701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.698757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.698811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.698866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.698925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.698965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.698970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.699037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.699099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.699158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.699215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.699331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.699338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.699403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:06.699462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:06.699521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:06.699582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:06.699647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:06.699652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:06.699705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904004:5192], now have 1 active actors on pipe
2025-10-01T14:15:06.699924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256682280904004:5192]
2025-10-01T14:15:06.699934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:06.699937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:06.699958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:06.699964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2434 reason: error at write: Disconnected sessionId: src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0
2025-10-01T14:15:06.700181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2434 sessionId: src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0 is DEAD
2025-10-01T14:15:06.700340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:06.700351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Write session will restart in 0.009042s
2025-10-01T14:15:06.700377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Write session: Do CDS request
2025-10-01T14:15:06.700382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:06.700477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:06.710887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.710976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:06.710996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2435
2025-10-01T14:15:06.711142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.711175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:06.711186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:06.711189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:06.711561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2435 sessionId:  describe result for acl check
2025-10-01T14:15:06.711595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:06.711601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:06.711603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:06.711617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256682280904171:4633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:06.712125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256682280904171:4633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:06.715179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256682280904171:4633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:06.718438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256682280904171:4633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:06.718456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256682280904171:4633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:06.718460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256682280904171:4633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:06.718471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:06.719274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:06.721272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:06.721497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:06.721507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:06.721517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:06.721569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:06.721607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256679903988706:8264]
2025-10-01T14:15:06.722285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:06.722622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:06.722679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:06.722995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:06.723076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.723083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.723084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.723085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.723086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.723088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.723089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.723090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.723091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.723093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.723094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.723095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.723096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.723097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.723103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.723113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.723118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.723122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.723126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.723130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.723134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.723137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.723141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.723145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.723149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.723152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.723156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.723159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.723167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.723175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.723181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.723186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.723191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.723196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.723200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.723205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.723209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.723214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.723219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.723223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.723228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.723233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.723245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.723251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.723255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.723264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.723269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.723274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.723284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.723289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.723297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.723302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.723311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.723316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.723324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.723329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.723356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:06.727258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:06.728080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:06.728094Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:06.728096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:06.728099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:06.728105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2434 [2:7556256679903988706:8264]
2025-10-01T14:15:06.728118Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:06.728133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:06.728139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.728141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.728143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.728155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:06.728162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:06.728166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:06.728209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.728215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.728216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.728218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:06.728220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:06.728274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:06.728282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.728293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.728303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.728317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:06.728335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904391:4633], now have 1 active actors on pipe
2025-10-01T14:15:06.728345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904012:2446], now have 1 active actors on pipe
2025-10-01T14:15:06.728353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.728355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.728357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.728371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:06.728379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:06.728383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:06.728384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:06.728386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:06.728399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:06.728403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:06.728443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.728451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:06.728454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:06.728480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2434
2025-10-01T14:15:06.728480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2434
2025-10-01T14:15:06.728538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.728557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.728584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:06.728595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.728600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.728603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:06.728616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.728628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:06.728646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.728857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.728873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.728897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.729002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2435 partition: 0 MaxSeqNo: 45 sessionId: src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0
2025-10-01T14:15:06.729355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eff301-4f2a4e74-d1312e1e-896d950c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:06.732442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Write session: try to update token
2025-10-01T14:15:06.732461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:06.748289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId: src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:06.749673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:06.749697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:06.749699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:06.749701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:06.749712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.749718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.749722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256679903988701:8264]
2025-10-01T14:15:06.749760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:06.749766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:06.749770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:06.749772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:06.749780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.749782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:06.749913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:06.750811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:06.800182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256682280904405:5192]
2025-10-01T14:15:06.800433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2434, pipe: [1:7556256682280904405:5192]
2025-10-01T14:15:06.895684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:06.896190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.896206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.896242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904405:5192], now have 1 active actors on pipe
2025-10-01T14:15:06.896406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:06.896461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:06.896479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:06.896497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256682280904405:5192]
2025-10-01T14:15:06.896514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:06.896530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2435 reason: error at write: Disconnected sessionId: src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0
2025-10-01T14:15:06.896707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2435 sessionId: src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0 is DEAD
2025-10-01T14:15:06.896814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:06.896823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Write session will restart in 0.007307s
2025-10-01T14:15:06.896847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Write session: Do CDS request
2025-10-01T14:15:06.896853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:06.904922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.904966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:06.904981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2436
2025-10-01T14:15:06.905125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:06.905156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:06.905166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:06.905169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:06.905657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2436 sessionId:  describe result for acl check
2025-10-01T14:15:06.905688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:06.905690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:06.905692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:06.905696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256682280904503:4591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:06.906186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256682280904503:4591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:06.907912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256682280904503:4591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:06.910551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256682280904503:4591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:06.910565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256682280904503:4591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:06.910569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256682280904503:4591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:06.910575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:06.914961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:06.917041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:06.917185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:06.917193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:06.917200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:06.917231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:06.917260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256679903988987:8249]
2025-10-01T14:15:06.917642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:06.917868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:06.917907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:06.918118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:06.918154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.918158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.918159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.918160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.918160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.918161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.918161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.918162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.918163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.918163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.918165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.918165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.918166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.918166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.918169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.918176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.918178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.918180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.918182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.918185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.918187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.918189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.918191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.918193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.918195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.918197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.918199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.918201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.918206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.918210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:06.918213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.918216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:06.918219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.918222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:06.918224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.918227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:06.918229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.918232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:06.918234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.918237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:06.918239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.918242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:06.918248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.918251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:06.918253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.918259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:06.918262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.918264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.918270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.918272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.918275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.918277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.918280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.918283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:06.918285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.918288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:06.918308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:06.921794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:06.922509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:06.922525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:06.922527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:06.922530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:06.922535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2435 [2:7556256679903988987:8249]
2025-10-01T14:15:06.922549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:06.922564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:06.922567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.922571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.922572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.922586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:06.922591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:06.922596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:06.922642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.922643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.922645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.922647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:06.922650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:06.922713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:06.922715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.922725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:06.922733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:06.922746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:06.922760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.922763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.922764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.922773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:06.922785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:06.922786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:06.922789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:06.922792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:06.922797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:06.922800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:06.922809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904432:2446], now have 1 active actors on pipe
2025-10-01T14:15:06.922813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904698:4591], now have 1 active actors on pipe
2025-10-01T14:15:06.922832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.922841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:06.922848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:06.926920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2435
2025-10-01T14:15:06.926964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2435
2025-10-01T14:15:06.928033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.928053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.928086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:06.928097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:06.928103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:06.928106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:06.928121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:06.928137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:06.928158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.928411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:06.928420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:06.928433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:06.928563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2436 partition: 0 MaxSeqNo: 45 sessionId: src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0
2025-10-01T14:15:06.928984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f9834-9d89e5ad-5616f770-93d4fb01_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:06.932643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Write session: try to update token
2025-10-01T14:15:06.932662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:06.951381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId: src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:06.952776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:06.952800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:06.952802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:06.952804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:06.952817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.952823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.952827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256679903988982:8249]
2025-10-01T14:15:06.952885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:06.952897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:06.952904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:06.952904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:06.952909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:06.952912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:06.953057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:06.954876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:06.996812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256682280904823:5192]
2025-10-01T14:15:06.997036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2435, pipe: [1:7556256682280904823:5192]
2025-10-01T14:15:07.099436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:07.099900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.099915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.099963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256682280904823:5192], now have 1 active actors on pipe
2025-10-01T14:15:07.100167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:07.100220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:07.100229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256682280904823:5192]
2025-10-01T14:15:07.100256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:07.100347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0
2025-10-01T14:15:07.100534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2436 sessionId: src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0 is DEAD
2025-10-01T14:15:07.100709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:07.100717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Write session will restart in 0.005360s
2025-10-01T14:15:07.100743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Write session: Do CDS request
2025-10-01T14:15:07.100749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:07.106915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.107052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:07.107075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2437
2025-10-01T14:15:07.107238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.107271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:07.107277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:07.107287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:07.107763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2437 sessionId:  describe result for acl check
2025-10-01T14:15:07.107795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:07.107802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:07.107804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:07.107810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256686575872150:4566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:07.108338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256686575872150:4566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:07.110322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256686575872150:4566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:07.113468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256686575872150:4566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:07.113485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256686575872150:4566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:07.113488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256686575872150:4566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:07.113496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:07.123927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:07.126421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:07.126655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:07.126671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:07.126683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:07.126767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:07.126825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256684198956555:8246]
2025-10-01T14:15:07.127460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:07.127806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:07.127879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:07.128237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:07.128302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.128308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.128310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.128312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.128313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.128314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.128315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.128316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.128318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.128319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.128320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.128322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.128323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.128324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.128330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.128341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.128346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.128350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.128354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.128358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.128366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.128370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.128378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.128383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.128391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.128399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.128407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.128412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.128425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.128437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.128447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.128456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.128465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.128475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.128484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.128489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.128494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.128500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.128509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.128519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.128528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.128537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.128555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.128564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.128573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.128582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.128589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.128598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.128607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.128616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.128624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.128633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.128642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.128652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.128660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.128665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.128708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:07.132880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:07.133792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:07.133819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:07.133822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:07.133828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:07.133835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2436 [2:7556256684198956555:8246]
2025-10-01T14:15:07.133858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:07.133879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:07.133890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.133894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.133897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.133913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:07.133924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:07.133932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:07.134001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.134011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.134014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.134017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:07.134020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:07.134090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:07.134097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.134108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.134116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.134131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:07.134148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.134154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.134156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.134170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:07.134178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:07.134182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:07.134184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:07.134205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872283:4566], now have 1 active actors on pipe
2025-10-01T14:15:07.134209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872135:2446], now have 1 active actors on pipe
2025-10-01T14:15:07.134217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:07.134229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:07.134237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:07.134235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2436
2025-10-01T14:15:07.134268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.134237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2436
2025-10-01T14:15:07.134278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:07.134307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:07.134311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.134316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.134346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:07.134357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.134365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.134385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:07.134397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.134410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:07.134427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.134579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.134587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.134601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.134675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2437 partition: 0 MaxSeqNo: 45 sessionId: src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0
2025-10-01T14:15:07.134998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2d7cff-bc683c9b-3905bc00-acbfd8e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:07.137833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Write session: try to update token
2025-10-01T14:15:07.137851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:07.155310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId: src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:07.155469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:07.155492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:07.155495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:07.155497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:07.155508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.155514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.155519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256684198956550:8246]
2025-10-01T14:15:07.155573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:07.155585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.155587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:07.155592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:07.155594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:07.155597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:07.155752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:07.157889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:07.200590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256686575872533:5192]
2025-10-01T14:15:07.200902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2436, pipe: [1:7556256686575872533:5192]
2025-10-01T14:15:07.285985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:07.286286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.286298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.286333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872533:5192], now have 1 active actors on pipe
2025-10-01T14:15:07.286597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:07.286622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:07.286619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:07.286639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:07.286689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256686575872533:5192]
2025-10-01T14:15:07.286700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2437 reason: error at write: Disconnected sessionId: src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0
2025-10-01T14:15:07.286939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2437 sessionId: src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0 is DEAD
2025-10-01T14:15:07.287098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:07.287110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Write session will restart in 0.007479s
2025-10-01T14:15:07.287134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Write session: Do CDS request
2025-10-01T14:15:07.287139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:07.295802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.295907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:07.295924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2438
2025-10-01T14:15:07.296031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.296057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:07.296060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:07.296063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:07.296407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2438 sessionId:  describe result for acl check
2025-10-01T14:15:07.296434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:07.296435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:07.296436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:07.296440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256686575872670:4557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:07.296882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256686575872670:4557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:07.298742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256686575872670:4557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:07.301764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256686575872670:4557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:07.301778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256686575872670:4557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:07.301781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256686575872670:4557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:07.301786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:07.304233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:07.306180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:07.306435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:07.306449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:07.306462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:07.306531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:07.306595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256684198956859:8220]
2025-10-01T14:15:07.307275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:07.307570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:07.307626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:07.307994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:07.308084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.308091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.308093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.308094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.308095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.308096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.308097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.308098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.308099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.308101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.308101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.308103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.308104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.308106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.308111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.308121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.308125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.308129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.308132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.308135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.308138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.308141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.308144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.308148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.308151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.308154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.308157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.308160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.308170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.308178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.308184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.308189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.308194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.308198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.308203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.308207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.308212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.308217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.308221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.308226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.308231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.308236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.308241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.308246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.308252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.308257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.308261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.308265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.308269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.308286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.308291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.308302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.308306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.308310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.308314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.308354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:07.311810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:07.313066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:07.313077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:07.313079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:07.313082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:07.313088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2437 [2:7556256684198956859:8220]
2025-10-01T14:15:07.313102Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:07.313116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:07.313119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.313122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.313124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.313136Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:07.313144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:07.313150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:07.313204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.313210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.313212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.313215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:07.313218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:07.313279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:07.313286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.313295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.313304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.313317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:07.313336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872894:4557], now have 1 active actors on pipe
2025-10-01T14:15:07.313342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872537:2446], now have 1 active actors on pipe
2025-10-01T14:15:07.313348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.313350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.313352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.313365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:07.313380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:07.313383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:07.313387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:07.313389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:07.313396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:07.313399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:07.313419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.313426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:07.313428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:07.313402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2437
2025-10-01T14:15:07.313440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.313449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.313402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2437
2025-10-01T14:15:07.313491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:07.313501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.313505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.313507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:07.313515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.313526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:07.313545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.313696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.313704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.313717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.313779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2438 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0
2025-10-01T14:15:07.314098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e9c36b-4f92be50-38823a92-b2d259a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:07.317492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Write session: try to update token
2025-10-01T14:15:07.317517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:07.332696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId: src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:07.333457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:07.333476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:07.333479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:07.333481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:07.333490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.333495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.333499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256684198956854:8220]
2025-10-01T14:15:07.333544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:07.333547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:07.333549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:07.333552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:07.333553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.333557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:07.333701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:07.334973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:07.386915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256686575872930:5192]
2025-10-01T14:15:07.387110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2437, pipe: [1:7556256686575872930:5192]
2025-10-01T14:15:07.469198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:07.469490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.469507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.469540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872930:5192], now have 1 active actors on pipe
2025-10-01T14:15:07.469741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:07.469770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:07.469791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:07.469812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256686575872930:5192]
2025-10-01T14:15:07.469833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:07.469846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2438 reason: error at write: Disconnected sessionId: src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0
2025-10-01T14:15:07.470031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2438 sessionId: src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0 is DEAD
2025-10-01T14:15:07.470158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:07.470169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Write session will restart in 0.005825s
2025-10-01T14:15:07.470191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Write session: Do CDS request
2025-10-01T14:15:07.470197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:07.476842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.476946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:07.476970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2439
2025-10-01T14:15:07.477092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.477131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:07.477142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:07.477146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:07.477529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2439 sessionId:  describe result for acl check
2025-10-01T14:15:07.477565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:07.477575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:07.477576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:07.477581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256686575872986:4535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:07.478100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256686575872986:4535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:07.480425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256686575872986:4535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:07.483206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256686575872986:4535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:07.483224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256686575872986:4535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:07.483227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256686575872986:4535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:07.483234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:07.489187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:07.491338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:07.491543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:07.491554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:07.491565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:07.491618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:07.491657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256684198957133:8216]
2025-10-01T14:15:07.492213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:07.492503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:07.492557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:07.492848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:07.492907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.492913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.492914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.492916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.492917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.492918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.492920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.492921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.492922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.492923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.492924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.492925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.492926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.492927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.492932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.492941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.492944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.492948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.492952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.492955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.492959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.492962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.492965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.492969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.492972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.492976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.492984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.492987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.492998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.493010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.493020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.493029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.493037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.493046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.493054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.493059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.493067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.493076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.493084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.493088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.493097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.493105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.493113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.493118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.493124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.493132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.493140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.493148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.493152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.493160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.493168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.493173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.493182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.493190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.493196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.493200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.493239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:07.496762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:07.497565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:07.497578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:07.497580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:07.497583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:07.497590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2438 [2:7556256684198957133:8216]
2025-10-01T14:15:07.497605Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:07.497629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:07.497632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.497635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.497637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.497652Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:07.497657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:07.497663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:07.497718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.497726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.497728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.497731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:07.497734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:07.497797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:07.497807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.497817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.497827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.497840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:07.497858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575872933:2446], now have 1 active actors on pipe
2025-10-01T14:15:07.497866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575873203:4535], now have 1 active actors on pipe
2025-10-01T14:15:07.497873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.497874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.497876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.497890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:07.497905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:07.497908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:07.497913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:07.497915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:07.497920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:07.497923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:07.497952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.497962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:07.497964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:07.497930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2438
2025-10-01T14:15:07.497943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2438
2025-10-01T14:15:07.497990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.498000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.498030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6436456e-397d99b9-801e0922-7de786f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:07.498041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.498046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.498049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:07.498057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.498065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:07.498086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.498248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.498258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.498272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.498353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2439 partition: 0 MaxSeqNo: 45 sessionId: src_id|6436456e-397d99b9-801e0922-7de786f9_0
2025-10-01T14:15:07.498748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b7a0d5-97ac9c14-efe246a-1710e95_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6436456e-397d99b9-801e0922-7de786f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:07.501653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Write session: try to update token
2025-10-01T14:15:07.501673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:07.517496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId: src_id|6436456e-397d99b9-801e0922-7de786f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:07.519189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:07.519209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:07.519211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:07.519213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:07.519222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.519225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.519229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256684198957128:8216]
2025-10-01T14:15:07.519271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:07.519277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.519278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:07.519417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:07.519523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:07.519536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:07.519540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:07.520095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:07.570228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256686575873334:5192]
2025-10-01T14:15:07.570498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2438, pipe: [1:7556256686575873334:5192]
2025-10-01T14:15:07.658612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:07.658861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.658875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.658919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575873334:5192], now have 1 active actors on pipe
2025-10-01T14:15:07.659117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:07.659200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:07.659256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256686575873334:5192]
2025-10-01T14:15:07.659278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:07.659359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2439 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6436456e-397d99b9-801e0922-7de786f9_0
2025-10-01T14:15:07.659526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2439 sessionId: src_id|6436456e-397d99b9-801e0922-7de786f9_0 is DEAD
2025-10-01T14:15:07.659677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:07.659687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Write session will restart in 0.006904s
2025-10-01T14:15:07.659708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Write session: Do CDS request
2025-10-01T14:15:07.659712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:07.667971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.668082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:07.668102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2440
2025-10-01T14:15:07.668206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.668237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:07.668246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:07.668250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:07.668669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2440 sessionId:  describe result for acl check
2025-10-01T14:15:07.668711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:07.668721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:07.668723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:07.668728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256686575873396:4515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:07.669244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256686575873396:4515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:07.671505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256686575873396:4515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:07.674112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256686575873396:4515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:07.674126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256686575873396:4515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:07.674129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256686575873396:4515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:07.674137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:07.680041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:07.681978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:07.682195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:07.682205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:07.682216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:07.682262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:07.682317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256684198957422:8208]
2025-10-01T14:15:07.682926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:07.683267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:07.683326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:07.683653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:07.683735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.683743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.683744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.683746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.683747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.683748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.683750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.683751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.683752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.683753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.683754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.683755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.683756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.683757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.683763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.683774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.683778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.683782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.683786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.683790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.683794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.683797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.683801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.683806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.683810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.683814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.683818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.683821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.683829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.683836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.683843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.683849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.683854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.683858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.683863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.683869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.683873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.683878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.683883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.683889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.683893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.683898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.683902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.683917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.683922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.683927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.683932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.683937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.683941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.683947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.683951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.683956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.683963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.683968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.683973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.683978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.684014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:07.687746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:07.688906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:07.688924Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:07.688927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:07.688931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:07.688937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2439 [2:7556256684198957422:8208]
2025-10-01T14:15:07.688952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:07.688969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:07.688972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.688976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.688979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.688995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:07.689002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:07.689007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:07.689065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.689076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.689078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.689082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:07.689084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:07.689150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:07.689158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.689171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.689186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.689206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:07.689229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575873342:2446], now have 1 active actors on pipe
2025-10-01T14:15:07.689236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575873605:4515], now have 1 active actors on pipe
2025-10-01T14:15:07.689243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.689249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.689253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.689267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:07.689281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:07.689286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:07.689290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:07.689292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:07.689301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:07.689304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:07.689289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2439
2025-10-01T14:15:07.689338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.689314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2439
2025-10-01T14:15:07.689351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:07.689356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:07.689371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.689380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.689429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:07.689446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.689450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.689452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:07.689460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.689469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:07.689490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.689639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.689648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.689663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.689735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2440 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0
2025-10-01T14:15:07.690051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6436456e-397d99b9-801e0922-7de786f9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:07.692836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Write session: try to update token
2025-10-01T14:15:07.692854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:07.706644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId: src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:07.709082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:07.709409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.709428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.709467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:07.709557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:07.714396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:07.714415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:07.714418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:07.714420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:07.714429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.714433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.714437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256684198957417:8208]
2025-10-01T14:15:07.714486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:07.714489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:07.714495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:07.714496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.714498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:07.714499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:07.714614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:07.759657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256686575873739:5192]
2025-10-01T14:15:07.759938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2439, pipe: [1:7556256686575873739:5192]
2025-10-01T14:15:07.857557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:07.865612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.865640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.865800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.865866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.865925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.865987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.866527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.866539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.866607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.866665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.866725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.866792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.866833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.866845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.866908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.866963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.867023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.867084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.867126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.867131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.867194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.867251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.867305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.867362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.867455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.867461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.867519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.867573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.867627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.867683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.867730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.867734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.867806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.867869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.867935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.868006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.868055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.868063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.868140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.868212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.868284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.868354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.868459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.868467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.868548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.868617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.868683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.868750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.868802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.868809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.868881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.868943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.869010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.869085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.869139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.869145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.869222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:07.869292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:07.869365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:07.869436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:07.869485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:07.869491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:07.869554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575873739:5192], now have 1 active actors on pipe
2025-10-01T14:15:07.869812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:07.869818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256686575873739:5192]
2025-10-01T14:15:07.869827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:07.869840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:07.869849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2440 reason: error at write: Disconnected sessionId: src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0
2025-10-01T14:15:07.870020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2440 sessionId: src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0 is DEAD
2025-10-01T14:15:07.870136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:07.870143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Write session will restart in 0.008111s
2025-10-01T14:15:07.870170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Write session: Do CDS request
2025-10-01T14:15:07.870177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:07.870167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:07.879891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.879983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:07.880001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2441
2025-10-01T14:15:07.880122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:07.880154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:07.880164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:07.880170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:07.880565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2441 sessionId:  describe result for acl check
2025-10-01T14:15:07.880616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:07.880622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:07.880623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:07.880628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256686575873857:4505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:07.881149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256686575873857:4505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:07.884218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256686575873857:4505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:07.887020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256686575873857:4505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:07.887037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256686575873857:4505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:07.887040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256686575873857:4505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:07.887048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:07.889619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:07.891692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:07.891895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:07.891910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:07.891922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:07.891979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:07.892024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256684198957700:8191]
2025-10-01T14:15:07.892610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:07.892881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:07.892928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:07.893229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:07.893290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.893296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.893297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.893298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.893299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.893301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.893302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.893303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.893304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.893305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.893306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.893307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.893308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.893309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.893315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.893325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.893329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.893333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.893337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.893342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.893346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.893350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.893354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.893358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.893362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.893370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.893374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.893381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.893388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.893399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:07.893410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.893418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:07.893429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.893435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:07.893439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.893448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:07.893453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.893462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:07.893467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.893473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:07.893482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.893490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:07.893495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.893504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:07.893513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.893522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:07.893532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.893541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.893549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.893558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.893566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.893575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.893583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.893592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:07.893600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.893605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:07.893647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:07.897091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:07.897935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:07.897945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:07.897946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:07.897949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:07.897954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2440 [2:7556256684198957700:8191]
2025-10-01T14:15:07.897967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:07.897979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:07.897984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.897987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.897988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.897999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:07.898006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:07.898010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:07.898047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.898051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.898053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.898055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:07.898057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:07.898102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:07.898107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.898114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:07.898123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:07.898132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:07.898147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.898151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.898153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.898159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:07.898166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:07.898168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:07.898170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:07.898173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575874100:4505], now have 1 active actors on pipe
2025-10-01T14:15:07.898176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575873742:2446], now have 1 active actors on pipe
2025-10-01T14:15:07.898187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:07.898201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:07.898208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:07.898228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.898236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:07.898240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:07.898281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2440
2025-10-01T14:15:07.898320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2440
2025-10-01T14:15:07.898331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.898342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.898386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf6233d0-67859942-6f65f175-209f5346_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:07.898396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:07.898400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:07.898402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:07.898410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:07.898421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:07.898439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.898584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:07.898591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:07.898605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:07.898687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2441 partition: 0 MaxSeqNo: 45 sessionId: src_id|bf6233d0-67859942-6f65f175-209f5346_0
2025-10-01T14:15:07.899049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d3aaba7-a952315d-10e76aea-4055d7a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bf6233d0-67859942-6f65f175-209f5346_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:07.901953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Write session: try to update token
2025-10-01T14:15:07.901974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:07.916073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId: src_id|bf6233d0-67859942-6f65f175-209f5346_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:07.917985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:07.918001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:07.918002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:07.918003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:07.918009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.918013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.918015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256684198957695:8191]
2025-10-01T14:15:07.918054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:07.918056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:07.918061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:07.918062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:07.918063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:07.918064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:07.918189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:07.918772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:07.970088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256686575874163:5192]
2025-10-01T14:15:07.970364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2440, pipe: [1:7556256686575874163:5192]
2025-10-01T14:15:08.061610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:08.062154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.062168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.062204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256686575874163:5192], now have 1 active actors on pipe
2025-10-01T14:15:08.062612Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:08.063168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:08.063179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Write session will restart in 0.008722s
2025-10-01T14:15:08.063204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Write session: Do CDS request
2025-10-01T14:15:08.063209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:08.062716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:08.062776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:08.062800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256686575874163:5192]
2025-10-01T14:15:08.062842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2441 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf6233d0-67859942-6f65f175-209f5346_0
2025-10-01T14:15:08.063040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2441 sessionId: src_id|bf6233d0-67859942-6f65f175-209f5346_0 is DEAD
2025-10-01T14:15:08.073864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.073935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:08.073953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2442
2025-10-01T14:15:08.074167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.074200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:08.074209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:08.074213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:08.074614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2442 sessionId:  describe result for acl check
2025-10-01T14:15:08.074648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:08.074655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:08.074657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:08.074661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256690870841556:4477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:08.075154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256690870841556:4477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:08.076752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256690870841556:4477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:08.081563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256690870841556:4477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:08.081582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256690870841556:4477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:08.081587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256690870841556:4477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:08.081596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:08.087522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:08.089894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:08.090134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:08.090144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:08.090156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:08.090219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:08.090260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256688493925280:8200]
2025-10-01T14:15:08.090874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:08.091208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:08.091251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:08.091548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:08.091600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.091606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.091607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.091608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.091609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.091610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.091611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.091612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.091614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.091615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.091616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.091617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.091618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.091620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.091625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.091635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.091639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.091644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.091648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.091652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.091656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.091660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.091664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.091668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.091672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.091675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.091679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.091683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.091690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.091698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.091709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.091719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.091724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.091734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.091738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.091747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.091752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.091761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.091766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.091775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.091780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.091789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.091793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.091802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.091807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.091816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.091820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.091831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.091841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.091846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.091850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.091856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.091860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.091865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.091869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.091875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.091919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:08.096634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:08.097312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:08.097327Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:08.097329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:08.097332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:08.097338Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2441 [2:7556256688493925280:8200]
2025-10-01T14:15:08.097350Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:08.097366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:08.097368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.097372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.097375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.097393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:08.097405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:08.097412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:08.097470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.097476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.097477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.097480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:08.097483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:08.097540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:08.097547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.097559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.097572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.097589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:08.097607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.097613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.097615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.097625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:08.097633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:08.097641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:08.097643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:08.097645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:08.097655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:08.097658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:08.097667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870841745:4477], now have 1 active actors on pipe
2025-10-01T14:15:08.097673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870841475:2446], now have 1 active actors on pipe
2025-10-01T14:15:08.097708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.097716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:08.097728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:08.097747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2441
2025-10-01T14:15:08.097790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2441
2025-10-01T14:15:08.097821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.097841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.097893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:08.097910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.097915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.097918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:08.098400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.098425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:08.098449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.100872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.100884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.100908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.101178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2442 partition: 0 MaxSeqNo: 45 sessionId: src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0
2025-10-01T14:15:08.101555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6233d0-67859942-6f65f175-209f5346_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:08.104384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Write session: try to update token
2025-10-01T14:15:08.104399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:08.117993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:08.118012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.118026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.118098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:08.118114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:08.118291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:08.118524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.118677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.118827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.119041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:08.119077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:08.124153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId: src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:08.126970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:08.128488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.128512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.128558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:08.128651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:08.130426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:08.130441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.130444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:08.130445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:08.130456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.130462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.130465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256688493925275:8200]
2025-10-01T14:15:08.130511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:08.130513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:08.130522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.130523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:08.130525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:08.130527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:08.130664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:08.163145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256690870841875:5192]
2025-10-01T14:15:08.163392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2441, pipe: [1:7556256690870841875:5192]
2025-10-01T14:15:08.276931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:08.284322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.284345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.284496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.284564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.284627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.284703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.285062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.285074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.285137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.285192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.285249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.285303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.285341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.285346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.285407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.285467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.285528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.285589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.285628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.285633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.285691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.285931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.285989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.286049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.286094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.286101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.286159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.286211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.286263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.286320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.286359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.286364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.286488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.286558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.286629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.286696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.286791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.286800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.286870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.286933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.287025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.287098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.287146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.287153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.287260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.287340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.287421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.287504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.287566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.287573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.287652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.287714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.287777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.287843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.287892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.287899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.287969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.288034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.288103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.288163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.288205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.288212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.288272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870841875:5192], now have 1 active actors on pipe
2025-10-01T14:15:08.288564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:08.288576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256690870841875:5192]
2025-10-01T14:15:08.288598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:08.288600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:08.288622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2442 reason: error at write: Disconnected sessionId: src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0
2025-10-01T14:15:08.288659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:08.288817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2442 sessionId: src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0 is DEAD
2025-10-01T14:15:08.288970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:08.288981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Write session will restart in 0.005823s
2025-10-01T14:15:08.289003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Write session: Do CDS request
2025-10-01T14:15:08.289009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:08.295947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.296011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:08.296028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2443
2025-10-01T14:15:08.296179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.296209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:08.296214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:08.296217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:08.296695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2443 sessionId:  describe result for acl check
2025-10-01T14:15:08.296753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:08.296760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:08.296761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:08.296767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256690870841958:4458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:08.297391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256690870841958:4458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:08.300110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256690870841958:4458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:08.303677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256690870841958:4458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:08.303699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256690870841958:4458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:08.303703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256690870841958:4458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:08.303712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:08.305854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:08.308283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:08.308566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:08.308578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:08.308591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:08.308643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:08.308685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256688493925589:8166]
2025-10-01T14:15:08.309276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:08.309603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:08.309648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:08.309948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:08.310012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.310017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.310018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.310019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.310021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.310023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.310024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.310025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.310026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.310027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.310029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.310030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.310030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.310032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.310036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.310046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.310049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.310053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.310057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.310060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.310064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.310067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.310071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.310075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.310078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.310081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.310084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.310088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.310096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.310104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.310110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.310115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.310119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.310124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.310129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.310134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.310138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.310142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.310152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.310157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.310166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.310171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.310179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.310184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.310193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.310197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.310201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.310210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.310220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.310228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.310233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.310241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.310246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.310255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.310259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.310267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.310300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:08.314234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:08.315135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:08.315150Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:08.315153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:08.315156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:08.315163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2442 [2:7556256688493925589:8166]
2025-10-01T14:15:08.315181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:08.315201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:08.315205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.315209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.315211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.315229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:08.315240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:08.315247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:08.315314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.315325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.315329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.315332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:08.315335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:08.315404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:08.315411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.315422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.315431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.315444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:08.315467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.315474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.315476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.315490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:08.315502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:08.315506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870841880:2446], now have 1 active actors on pipe
2025-10-01T14:15:08.315509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870842242:4458], now have 1 active actors on pipe
2025-10-01T14:15:08.315511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:08.315514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:08.315517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:08.315529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:08.315532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:08.315567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.315575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:08.315583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:08.315566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2442
2025-10-01T14:15:08.315594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2442
2025-10-01T14:15:08.315623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.315631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.315654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2135644e-1e56565d-540e61e2-92c67102_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:08.315664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.315669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.315672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:08.315680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.315688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:08.315707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.315831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.315841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.315857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.315948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2443 partition: 0 MaxSeqNo: 45 sessionId: src_id|2135644e-1e56565d-540e61e2-92c67102_0
2025-10-01T14:15:08.316327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55a52ef1-baaca895-4000a69e-354ec3ca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2135644e-1e56565d-540e61e2-92c67102_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:08.319685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Write session: try to update token
2025-10-01T14:15:08.319704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:08.326658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:08.326673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.326682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.326721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:08.326725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:08.326869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:08.327011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.327153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.327267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.327431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:08.327461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:08.335169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId: src_id|2135644e-1e56565d-540e61e2-92c67102_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:08.338793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:08.338985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.339004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.339040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:08.339113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:08.347658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:08.347677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.347680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:08.347683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:08.347693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.347696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.347701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256688493925584:8166]
2025-10-01T14:15:08.347750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:08.347757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.347759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:08.347764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:08.347765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:08.347767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:08.347892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:08.388913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256690870842278:5192]
2025-10-01T14:15:08.389149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2442, pipe: [1:7556256690870842278:5192]
2025-10-01T14:15:08.489201Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:08.497907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.497938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.498099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.498164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.498230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.498297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.498343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.498353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.498441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.498504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.498573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.498642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.498688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.498695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.498769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.498840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.498907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.498979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.499023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.499030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.499103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.499172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.499241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.499312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.499359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.499366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.499442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.499512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.499582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.499651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.499701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.499708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.499782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.499848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.499916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.499989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.500037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.500044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.500117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.500181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.500248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.500317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.500366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.500376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.500439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.500504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.500586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.500654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.500700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.500708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.500779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.500842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.500909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.500983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.501033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.501040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.501110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.501179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.501245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.501311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.501355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.501362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.501429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870842278:5192], now have 1 active actors on pipe
2025-10-01T14:15:08.501705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:08.501757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:08.501758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:08.501784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2443 reason: error at write: Disconnected sessionId: src_id|2135644e-1e56565d-540e61e2-92c67102_0
2025-10-01T14:15:08.501967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2443 sessionId: src_id|2135644e-1e56565d-540e61e2-92c67102_0 is DEAD
2025-10-01T14:15:08.502024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256690870842278:5192]
2025-10-01T14:15:08.502103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:08.502113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Write session will restart in 0.009892s
2025-10-01T14:15:08.502139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Write session: Do CDS request
2025-10-01T14:15:08.502145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:08.502759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:08.512935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.513003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:08.513023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2444
2025-10-01T14:15:08.513133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.513175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:08.513185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:08.513189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:08.513597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2444 sessionId:  describe result for acl check
2025-10-01T14:15:08.513632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:08.513641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:08.513643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:08.513648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256690870842478:4427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:08.514127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256690870842478:4427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:08.517047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256690870842478:4427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:08.519624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256690870842478:4427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:08.519640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256690870842478:4427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:08.519644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256690870842478:4427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:08.519652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:08.520281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:08.522620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:08.522804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:08.522811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:08.522820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:08.522867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:08.522897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256688493925870:8174]
2025-10-01T14:15:08.523460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:08.523741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:08.523777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:08.524066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:08.524123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.524130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.524131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.524132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.524133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.524135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.524136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.524137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.524139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.524140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.524141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.524143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.524144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.524145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.524149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.524159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.524163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.524167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.524171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.524175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.524179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.524182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.524186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.524190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.524194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.524197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.524201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.524205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.524212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.524219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.524224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.524230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.524234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.524239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.524243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.524248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.524252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.524257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.524261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.524266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.524271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.524276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.524280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.524285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.524289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.524295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.524299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.524304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.524308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.524313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.524317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.524322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.524328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.524336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.524340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.524350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.524386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:08.528042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:08.528703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:08.528715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:08.528719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:08.528723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:08.528729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2443 [2:7556256688493925870:8174]
2025-10-01T14:15:08.528741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:08.528758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:08.528766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.528769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.528773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.528788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:08.528797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:08.528805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:08.528864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.528869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.528870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.528873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:08.528875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:08.528927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:08.528932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.528939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.528945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.528954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:08.528970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.528976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.528977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.528987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:08.528996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:08.529001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:08.529006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:08.529009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:08.529010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:08.529011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:08.529040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870842669:4427], now have 1 active actors on pipe
2025-10-01T14:15:08.529047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870842281:2446], now have 1 active actors on pipe
2025-10-01T14:15:08.529048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.529076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:08.529088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:08.529081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2443
2025-10-01T14:15:08.529086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2443
2025-10-01T14:15:08.529135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.529144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.529168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:08.529176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.529181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.529183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:08.529193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.529205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:08.529223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.529363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.529368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.529378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.529448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2444 partition: 0 MaxSeqNo: 45 sessionId: src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0
2025-10-01T14:15:08.529830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2135644e-1e56565d-540e61e2-92c67102_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:08.532766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Write session: try to update token
2025-10-01T14:15:08.532785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:08.540410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:08.540429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.540440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.540489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:08.540504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:08.540702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:08.540864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.541025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.541184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.541386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:08.541427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:08.547711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId: src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:08.550250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:08.550482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.550502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.550547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:08.550630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:08.558623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:08.558640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.558642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:08.558644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:08.558656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.558660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.558664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256688493925865:8174]
2025-10-01T14:15:08.558717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:08.558730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.558728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:08.558737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:08.558736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:08.558741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:08.558882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:08.602386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256690870842687:5192]
2025-10-01T14:15:08.602576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2443, pipe: [1:7556256690870842687:5192]
2025-10-01T14:15:08.698948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:08.707322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.707353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.707530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.707598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.707667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.707739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.707793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.707805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.707874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.707943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.708011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.708082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.708134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.708142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.708214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.708285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.708354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.708429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.708481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.708490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.708580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.708649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.708719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.708793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.708843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.708852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.708925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.708992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.709059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.709128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.709178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.709186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.709281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.709347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.709415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.709486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.709541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.709550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.709621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.709688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.709758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.709832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.709881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.709889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.709955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.710020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.710089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.710157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.710204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.710213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.710283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.710347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.710435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.710504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.710554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.710562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.710631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.710701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.710769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.710840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.710907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.710917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.710992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870842687:5192], now have 1 active actors on pipe
2025-10-01T14:15:08.711231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:08.711265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:08.711283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:08.711289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256690870842687:5192]
2025-10-01T14:15:08.711308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:08.711310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2444 reason: error at write: Disconnected sessionId: src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0
2025-10-01T14:15:08.711523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2444 sessionId: src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0 is DEAD
2025-10-01T14:15:08.711674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:08.711685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Write session will restart in 0.006883s
2025-10-01T14:15:08.711710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Write session: Do CDS request
2025-10-01T14:15:08.711716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:08.719934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.720456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:08.720474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2445
2025-10-01T14:15:08.720606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.720640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:08.720650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:08.720657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:08.721035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2445 sessionId:  describe result for acl check
2025-10-01T14:15:08.721069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:08.721075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:08.721076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:08.721082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256690870842776:4430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:08.721587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256690870842776:4430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:08.723956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256690870842776:4430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:08.727349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256690870842776:4430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:08.727365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256690870842776:4430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:08.727369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256690870842776:4430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:08.727376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:08.730630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:08.732973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:08.733183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:08.733195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:08.733207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:08.733267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:08.733304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256688493926162:8167]
2025-10-01T14:15:08.733872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:08.734161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:08.734210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:08.734552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:08.734637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.734644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.734645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.734646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.734647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.734648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.734650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.734651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.734652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.734654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.734655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.734657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.734658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.734659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.734665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.734674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.734678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.734682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.734686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.734690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.734694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.734698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.734701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.734705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.734708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.734712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.734716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.734719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.734728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.734736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.734743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.734753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.734759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.734769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.734773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.734784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.734794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.734800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.734809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.734815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.734824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.734830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.734839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.734844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.734854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.734859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.734865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.734876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.734881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.734890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.734895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.734904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.734910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.734920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.734924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.734929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.734970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:08.738978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:08.740516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:08.740531Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:08.740534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:08.740538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:08.740554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2444 [2:7556256688493926162:8167]
2025-10-01T14:15:08.740572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:08.740590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:08.740598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.740601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.740604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.740620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:08.740630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:08.740636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:08.740695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.740697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.740699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.740702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:08.740704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:08.740782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:08.740785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.740797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.740809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.740825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:08.740843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870843041:4430], now have 1 active actors on pipe
2025-10-01T14:15:08.740847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870842693:2446], now have 1 active actors on pipe
2025-10-01T14:15:08.740853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.740856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.740858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.740873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:08.740891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:08.740904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:08.740910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:08.740913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:08.740914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:08.740918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:08.740944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.740952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:08.740939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2444
2025-10-01T14:15:08.740943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2444
2025-10-01T14:15:08.740975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:08.740995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.741000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.741024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:08.741031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.741041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.741043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:08.741052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.741061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:08.741080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.741257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.741272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.741295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.741387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2445 partition: 0 MaxSeqNo: 45 sessionId: src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0
2025-10-01T14:15:08.741759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460d1732-9e1d9647-ede2fb20-9c3047f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:08.744718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Write session: try to update token
2025-10-01T14:15:08.744735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:08.752472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:08.752490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.752499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.752553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:08.752735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:08.752875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.753006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.753124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:08.753301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:08.753303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:08.753328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:08.761025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId: src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:08.763882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:08.764108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.764131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.764170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:08.764270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:08.772772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:08.772793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.772796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:08.772798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:08.772811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.772815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.772819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256688493926157:8167]
2025-10-01T14:15:08.772872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:08.772876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:08.772881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.772882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:08.772883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:08.772890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:08.773029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:08.811315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256690870843096:5192]
2025-10-01T14:15:08.811581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2444, pipe: [1:7556256690870843096:5192]
2025-10-01T14:15:08.922619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:08.931289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.931317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.931468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.931532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.931591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.931652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.931697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.931707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.931770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.931830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.931892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.931976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.932023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.932031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.932103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.932166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.932227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.932292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.932341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.932348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.932426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.932495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.932569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.932635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.932682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.932689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.932758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.932822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.932885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.932947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.932993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.932999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.933066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.933126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.933189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.933254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.933299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.933305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.933372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.933429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.933491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.933557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.933602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.933608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.933668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.933733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.933802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.933868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.933998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.934006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.934077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.934141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.934205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.934270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.934311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.934318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.934397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:08.934457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:08.934520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:08.934583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:08.934628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:08.934636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:08.934697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870843096:5192], now have 1 active actors on pipe
2025-10-01T14:15:08.934892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256690870843096:5192]
2025-10-01T14:15:08.934948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:08.934950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:08.934979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2445 reason: error at write: Disconnected sessionId: src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0
2025-10-01T14:15:08.935210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2445 sessionId: src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0 is DEAD
2025-10-01T14:15:08.935318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:08.935328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Write session will restart in 0.008549s
2025-10-01T14:15:08.935361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Write session: Do CDS request
2025-10-01T14:15:08.935368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:08.935406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:08.935912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:08.944916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.944975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:08.944995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2446
2025-10-01T14:15:08.945114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:08.945143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:08.945152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:08.945156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:08.945591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2446 sessionId:  describe result for acl check
2025-10-01T14:15:08.945618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:08.945624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:08.945626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:08.945630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256690870843310:4385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:08.946138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256690870843310:4385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:08.948336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256690870843310:4385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:08.950675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256690870843310:4385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:08.950692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256690870843310:4385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:08.950695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256690870843310:4385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:08.950702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:08.953849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:08.954222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:08.954445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:08.954457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:08.954470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:08.954519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:08.954561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256688493926445:8169]
2025-10-01T14:15:08.955148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:08.955413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:08.955465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:08.955704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:08.955756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.955761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.955762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.955763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.955764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.955766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.955767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.955768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.955769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.955770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.955771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.955772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.955774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.955775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.955779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.955789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.955793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.955796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.955800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.955804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.955807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.955811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.955815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.955818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.955822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.955826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.955829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.955831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.955837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.955841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:08.955845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.955847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:08.955850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.955853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:08.955855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.955857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:08.955860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.955863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:08.955865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.955867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:08.955869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.955872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:08.955874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.955877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:08.955879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.955882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:08.955885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.955887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.955889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.955892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.955894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.955896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.955898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.955901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:08.955903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.955906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:08.955925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:08.959258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:08.960011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:08.960026Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:08.960029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:08.960032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:08.960038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2445 [2:7556256688493926445:8169]
2025-10-01T14:15:08.960051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:08.960071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:08.960079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.960083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.960089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.960105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:08.960115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:08.960122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:08.960181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.960188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.960190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.960193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:08.960196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:08.960261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:08.960268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.960278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:08.960294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:08.960313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:08.960332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2445
2025-10-01T14:15:08.960367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2445
2025-10-01T14:15:08.960336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870843498:4385], now have 1 active actors on pipe
2025-10-01T14:15:08.960344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256690870843111:2446], now have 1 active actors on pipe
2025-10-01T14:15:08.960352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.960354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.960356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.960366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:08.960374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:08.960377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:08.960379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:08.960380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:08.960394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:08.960397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:08.960415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.960419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.960458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.960467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:08.960474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:08.960481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:08.960493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:08.960497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:08.960499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:08.960512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:08.960520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:08.960569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.960700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.960708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.960722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:08.960786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2446 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0
2025-10-01T14:15:08.961083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db26e0c-f5e1f8b5-cbcce3b1-e7c0fc8c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:08.963942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Write session: try to update token
2025-10-01T14:15:08.963964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:08.977335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId: src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:08.979787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:08.981695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:08.981720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:08.981741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:08.981744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:08.981747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:08.981750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:08.981758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.981762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.981765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256688493926440:8169]
2025-10-01T14:15:08.981800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:08.981804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:08.981806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:08.981821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:08.981828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:08.981856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:08.982013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:09.035066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256695165810833:5192]
2025-10-01T14:15:09.035357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2445, pipe: [1:7556256695165810833:5192]
2025-10-01T14:15:09.118727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:09.118939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:09.118987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165810833:5192], now have 1 active actors on pipe
2025-10-01T14:15:09.119080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:09.119134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256695165810833:5192]
2025-10-01T14:15:09.119164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:09.119427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:09.119436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:09.119513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2446 reason: error at write: Disconnected sessionId: src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0
2025-10-01T14:15:09.119677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2446 sessionId: src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0 is DEAD
2025-10-01T14:15:09.119892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:09.119904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Write session will restart in 0.006570s
2025-10-01T14:15:09.119930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Write session: Do CDS request
2025-10-01T14:15:09.119939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:09.127891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.127976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:09.127992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2447
2025-10-01T14:15:09.128114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.128136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:09.128144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:09.128147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:09.128440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2447 sessionId:  describe result for acl check
2025-10-01T14:15:09.128465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:09.128469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:09.128470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:09.128474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256695165810977:4376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:09.128866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256695165810977:4376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:09.130539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256695165810977:4376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:09.133184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256695165810977:4376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:09.133202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256695165810977:4376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:09.133205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256695165810977:4376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:09.133213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:09.135112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:09.137287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:09.137437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:09.137447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:09.137457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:09.137492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:09.137520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256692788894030:8162]
2025-10-01T14:15:09.137913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:09.138111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:09.138137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:09.138325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:09.138361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.138365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.138366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.138381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.138383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.138383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.138384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.138386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.138387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.138387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.138389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.138390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.138391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.138392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.138396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.138402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.138404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.138406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.138408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.138410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.138412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.138414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.138416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.138418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.138419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.138421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.138423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.138425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.138430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.138435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.138438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.138441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.138443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.138446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.138448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.138451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.138454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.138456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.138458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.138461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.138465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.138470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.138476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.138485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.138493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.138498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.138505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.138508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.138514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.138517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.138520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.138526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.138529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.138531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.138537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.138539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.138559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:09.142053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:09.142716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:09.142730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:09.142733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:09.142736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:09.142744Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2446 [2:7556256692788894030:8162]
2025-10-01T14:15:09.142756Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:09.142771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:09.142774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.142778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.142780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.142795Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:09.142801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:09.142806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:09.142860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.142868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.142870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.142873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:09.142875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:09.142944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:09.142952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.142964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.142975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.142995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:09.143017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165811189:4376], now have 1 active actors on pipe
2025-10-01T14:15:09.143024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165810835:2446], now have 1 active actors on pipe
2025-10-01T14:15:09.143031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.143034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.143037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.143052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:09.143068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:09.143077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:09.143085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:09.143087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:09.143097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:09.143099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:09.143113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.143116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:09.143097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2446
2025-10-01T14:15:09.143136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:09.143099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2446
2025-10-01T14:15:09.143146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.143151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.143183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afb2eafd-529133e5-46eef015-28a624ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:09.143193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.143198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.143204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:09.143213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.143224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:09.143238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.143414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.143423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.143437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.143537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2447 partition: 0 MaxSeqNo: 45 sessionId: src_id|afb2eafd-529133e5-46eef015-28a624ab_0
2025-10-01T14:15:09.143928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae4377c-bf67744f-5680ba34-851fbecd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|afb2eafd-529133e5-46eef015-28a624ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:09.146961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Write session: try to update token
2025-10-01T14:15:09.146980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:09.160971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId: src_id|afb2eafd-529133e5-46eef015-28a624ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:09.163646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:09.163664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:09.163666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:09.163667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:09.163675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.163678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.163680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256692788894025:8162]
2025-10-01T14:15:09.163721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:09.163722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:09.163728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:09.163731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.163732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:09.163733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:09.163736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:09.163871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:09.219366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256695165811240:5192]
2025-10-01T14:15:09.219632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2446, pipe: [1:7556256695165811240:5192]
2025-10-01T14:15:09.299356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:09.299834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.299847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.299882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165811240:5192], now have 1 active actors on pipe
2025-10-01T14:15:09.300025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:09.300084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256695165811240:5192]
2025-10-01T14:15:09.300095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:09.300130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:09.300197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|afb2eafd-529133e5-46eef015-28a624ab_0
2025-10-01T14:15:09.300392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2447 sessionId: src_id|afb2eafd-529133e5-46eef015-28a624ab_0 is DEAD
2025-10-01T14:15:09.300513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:09.300523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Write session will restart in 0.007550s
2025-10-01T14:15:09.300557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Write session: Do CDS request
2025-10-01T14:15:09.300564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:09.308929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.309004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:09.309021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2448
2025-10-01T14:15:09.309120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.309149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:09.309158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:09.309161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:09.309574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2448 sessionId:  describe result for acl check
2025-10-01T14:15:09.309611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:09.309619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:09.309621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:09.309625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256695165811320:4345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:09.310115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256695165811320:4345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:09.312135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256695165811320:4345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:09.315157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256695165811320:4345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:09.315175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256695165811320:4345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:09.315179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256695165811320:4345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:09.315187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:09.319497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:09.321520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:09.321707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:09.321718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:09.321730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:09.321777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:09.321812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256692788894344:8144]
2025-10-01T14:15:09.322338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:09.322655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:09.322696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:09.322969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:09.323017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.323022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.323023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.323024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.323025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.323026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.323027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.323028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.323029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.323030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.323031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.323031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.323032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.323033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.323038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.323046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.323049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.323053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.323056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.323059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.323062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.323065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.323068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.323071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.323074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.323076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.323079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.323082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.323091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.323097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.323102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.323111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.323114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.323122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.323126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.323134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.323142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.323145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.323152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.323156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.323164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.323168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.323172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.323184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.323188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.323192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.323195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.323199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.323204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.323208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.323212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.323232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.323241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.323245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.323250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.323253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.323285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:09.327222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:09.328246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:09.328258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:09.328260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:09.328263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:09.328268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2447 [2:7556256692788894344:8144]
2025-10-01T14:15:09.328278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:09.328291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:09.328293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.328295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.328297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.328309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:09.328312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:09.328317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:09.328359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.328365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.328366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.328368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:09.328370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:09.328417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:09.328422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.328434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.328447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.328464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:09.328480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.328485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.328486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.328493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:09.328503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165811242:2446], now have 1 active actors on pipe
2025-10-01T14:15:09.328505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:09.328508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:09.328510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:09.328512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165811544:4345], now have 1 active actors on pipe
2025-10-01T14:15:09.328515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:09.328524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:09.328528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:09.328566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.328575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:09.328586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:09.328613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2447
2025-10-01T14:15:09.328643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2447
2025-10-01T14:15:09.328837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.328845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.328865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d44594da-95099653-2064f32c-e1252107_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:09.328874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.328877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.328879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:09.328886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.328896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:09.328909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.329054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.329068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.329092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.329170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2448 partition: 0 MaxSeqNo: 45 sessionId: src_id|d44594da-95099653-2064f32c-e1252107_0
2025-10-01T14:15:09.329550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb2eafd-529133e5-46eef015-28a624ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d44594da-95099653-2064f32c-e1252107_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:09.332249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Write session: try to update token
2025-10-01T14:15:09.332266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:09.348202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:09.348219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:09.348221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:09.348223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:09.348231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.348234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.348237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256692788894339:8144]
2025-10-01T14:15:09.348275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:09.348275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:09.348280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:09.348280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.348282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:09.348283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:09.348405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:09.350949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId: src_id|d44594da-95099653-2064f32c-e1252107_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:09.353562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:09.400109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256695165811648:5192]
2025-10-01T14:15:09.400366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2447, pipe: [1:7556256695165811648:5192]
2025-10-01T14:15:09.488415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:09.488924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.488940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.488972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165811648:5192], now have 1 active actors on pipe
2025-10-01T14:15:09.489184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:09.489201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:09.489206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256695165811648:5192]
2025-10-01T14:15:09.489224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:09.489226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:09.489278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2448 reason: error at write: Disconnected sessionId: src_id|d44594da-95099653-2064f32c-e1252107_0
2025-10-01T14:15:09.489475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2448 sessionId: src_id|d44594da-95099653-2064f32c-e1252107_0 is DEAD
2025-10-01T14:15:09.489591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:09.489601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Write session will restart in 0.009360s
2025-10-01T14:15:09.489620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Write session: Do CDS request
2025-10-01T14:15:09.489625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:09.499901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.499978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:09.500004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2449
2025-10-01T14:15:09.500088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.500112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:09.500120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:09.500124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:09.500447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2449 sessionId:  describe result for acl check
2025-10-01T14:15:09.500474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:09.500476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:09.500477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:09.500480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256695165811866:4317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:09.500867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256695165811866:4317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:09.503054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256695165811866:4317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:09.505633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256695165811866:4317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:09.505646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256695165811866:4317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:09.505649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256695165811866:4317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:09.505655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:09.509210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:09.509632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:09.509807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:09.509818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:09.509830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:09.509882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:09.509918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256692788894630:8131]
2025-10-01T14:15:09.510530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:09.510839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:09.510888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:09.511191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:09.511249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.511255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.511256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.511257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.511258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.511259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.511260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.511261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.511263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.511264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.511265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.511266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.511267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.511269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.511274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.511284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.511288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.511291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.511299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.511302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.511310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.511317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.511320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.511328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.511332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.511339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.511345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.511352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.511359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.511369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.511375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.511379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.511384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.511389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.511397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.511402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.511410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.511415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.511423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.511432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.511441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.511450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.511457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.511462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.511471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.511480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.511487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.511496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.511506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.511511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.511516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.511524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.511532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.511541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.511549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.511557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.511597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:09.515157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:09.516068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:09.516086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:09.516089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:09.516092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:09.516099Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2448 [2:7556256692788894630:8131]
2025-10-01T14:15:09.516113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:09.516138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:09.516141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.516144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.516146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.516161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:09.516171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:09.516181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:09.516239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.516246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.516248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.516252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:09.516254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:09.516321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:09.516328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.516341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.516356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.516377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:09.516398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812042:4317], now have 1 active actors on pipe
2025-10-01T14:15:09.516406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165811651:2446], now have 1 active actors on pipe
2025-10-01T14:15:09.516413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.516420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.516422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.516438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:09.516455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:09.516457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:09.516461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:09.516462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:09.516438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2448
2025-10-01T14:15:09.516474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:09.516438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2448
2025-10-01T14:15:09.516481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:09.516520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.516529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.516800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.516815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:09.516830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:09.516848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98d94859-b6857a67-33cb34f7-69dee541_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:09.516861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.516865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.516867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:09.516876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.516890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:09.516919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.517055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.517063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.517078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.517133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2449 partition: 0 MaxSeqNo: 45 sessionId: src_id|98d94859-b6857a67-33cb34f7-69dee541_0
2025-10-01T14:15:09.517436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44594da-95099653-2064f32c-e1252107_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98d94859-b6857a67-33cb34f7-69dee541_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:09.520018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Write session: try to update token
2025-10-01T14:15:09.520032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:09.533113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId: src_id|98d94859-b6857a67-33cb34f7-69dee541_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:09.535414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:09.536258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.536284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.536305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:09.536308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:09.536310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:09.536312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:09.536320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.536323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.536327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256692788894625:8131]
2025-10-01T14:15:09.536370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:09.536382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:09.536382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:09.536386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:09.536387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.536390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:09.536534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:09.589559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256695165812060:5192]
2025-10-01T14:15:09.589815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2448, pipe: [1:7556256695165812060:5192]
2025-10-01T14:15:09.676441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:09.676741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:09.676792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812060:5192], now have 1 active actors on pipe
2025-10-01T14:15:09.676910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:09.677012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256695165812060:5192]
2025-10-01T14:15:09.677017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:09.677019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:09.677048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:09.677094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2449 reason: error at write: Disconnected sessionId: src_id|98d94859-b6857a67-33cb34f7-69dee541_0
2025-10-01T14:15:09.677277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2449 sessionId: src_id|98d94859-b6857a67-33cb34f7-69dee541_0 is DEAD
2025-10-01T14:15:09.677406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:09.677417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Write session will restart in 0.007732s
2025-10-01T14:15:09.677434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Write session: Do CDS request
2025-10-01T14:15:09.677441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:09.685897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.685937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:09.685953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2450
2025-10-01T14:15:09.686114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.686160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:09.686170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:09.686174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:09.686591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2450 sessionId:  describe result for acl check
2025-10-01T14:15:09.686631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:09.686638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:09.686639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:09.686644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256695165812204:4320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:09.687154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256695165812204:4320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:09.689236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256695165812204:4320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:09.692273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256695165812204:4320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:09.692287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256695165812204:4320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:09.692291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256695165812204:4320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:09.692298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:09.694069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:09.696187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:09.696328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:09.696338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:09.696346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:09.696375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:09.696403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256692788894928:8113]
2025-10-01T14:15:09.696790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:09.697295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:09.697333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:09.697535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:09.697567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.697571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.697572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.697573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.697573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.697574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.697575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.697575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.697576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.697576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.697577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.697578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.697578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.697579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.697583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.697588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.697591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.697593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.697594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.697596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.697598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.697601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.697603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.697605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.697608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.697610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.697612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.697614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.697618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.697622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.697626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.697629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.697631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.697634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.697637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.697639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.697642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.697645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.697647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.697650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.697652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.697655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.697657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.697660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.697662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.697665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.697669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.697672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.697675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.697677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.697680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.697682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.697685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.697687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.697690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.697693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.697713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:09.701000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:09.701657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:09.701668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:09.701669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:09.701672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:09.701676Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2449 [2:7556256692788894928:8113]
2025-10-01T14:15:09.701686Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:09.701698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:09.701700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.701702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.701703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.701715Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:09.701718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:09.701722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:09.701759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.701765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.701766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.701768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:09.701769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:09.701826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:09.701832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.701842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.701855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.701873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:09.701890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812068:2446], now have 1 active actors on pipe
2025-10-01T14:15:09.701895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812460:4320], now have 1 active actors on pipe
2025-10-01T14:15:09.701901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.701905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.701906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.701917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:09.701928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:09.701933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:09.701936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:09.701939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:09.701945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:09.701951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:09.701940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2449
2025-10-01T14:15:09.701952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2449
2025-10-01T14:15:09.701971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.701977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:09.701978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:09.701993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.701997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.702037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2508621d-e85ad96f-fbac40d7-557eade5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:09.702048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.702052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.702054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:09.702063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.702072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:09.702091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.702242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.702248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.702261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.702333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2450 partition: 0 MaxSeqNo: 45 sessionId: src_id|2508621d-e85ad96f-fbac40d7-557eade5_0
2025-10-01T14:15:09.702676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98d94859-b6857a67-33cb34f7-69dee541_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2508621d-e85ad96f-fbac40d7-557eade5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:09.705181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Write session: try to update token
2025-10-01T14:15:09.705197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:09.717284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId: src_id|2508621d-e85ad96f-fbac40d7-557eade5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:09.719575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:09.721309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.721331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.721349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:09.721351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:09.721353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:09.721354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:09.721360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.721362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.721365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256692788894922:8113]
2025-10-01T14:15:09.721397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:09.721405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:09.721409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:09.721417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:09.721427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.721433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:09.721545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:09.777444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256695165812473:5192]
2025-10-01T14:15:09.777680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2449, pipe: [1:7556256695165812473:5192]
2025-10-01T14:15:09.855283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:09.855509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:09.855561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812473:5192], now have 1 active actors on pipe
2025-10-01T14:15:09.855605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:09.855719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:09.855793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256695165812473:5192]
2025-10-01T14:15:09.866167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:09.866181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:09.866206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2450 reason: error at write: Disconnected sessionId: src_id|2508621d-e85ad96f-fbac40d7-557eade5_0
2025-10-01T14:15:09.866358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2450 sessionId: src_id|2508621d-e85ad96f-fbac40d7-557eade5_0 is DEAD
2025-10-01T14:15:09.866527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:09.866535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Write session will restart in 0.007067s
2025-10-01T14:15:09.866559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Write session: Do CDS request
2025-10-01T14:15:09.866569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:09.874836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.874917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:09.874938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2451
2025-10-01T14:15:09.875041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:09.875079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:09.875089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:09.875094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:09.875530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2451 sessionId:  describe result for acl check
2025-10-01T14:15:09.875564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:09.875570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:09.875572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:09.875577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256695165812781:4295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:09.876101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256695165812781:4295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:09.878109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256695165812781:4295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:09.878215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:09.881494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:09.881704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:09.881715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:09.881727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:09.881771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:09.881806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256692788895215:8123]
2025-10-01T14:15:09.881811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256695165812781:4295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:09.881828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256695165812781:4295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:09.881831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256695165812781:4295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:09.881840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:09.882189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:09.882467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:09.882517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:09.882832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:09.882878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.882885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.882886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.882887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.882888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.882890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.882891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.882892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.882893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.882894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.882895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.882896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.882901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.882910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.882914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.882917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.882919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.882923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.882926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.882930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.882933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.882938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.882941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.882945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.882948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.882951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.882958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.882966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:09.882972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.882977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:09.882982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.882987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:09.882992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.882997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:09.883001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.883005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:09.883009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.883013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:09.883018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.883022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:09.883026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.883031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:09.883034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.883039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:09.883042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.883052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.883056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.883061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.883069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.883073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.883077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.883085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:09.883088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.883093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:09.883133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:09.886734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:09.887844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:09.887857Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:09.887859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:09.887863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:09.887869Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2450 [2:7556256692788895215:8123]
2025-10-01T14:15:09.887884Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:09.887898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:09.887905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.887908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.887910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.887926Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:09.887936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:09.887941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:09.887998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.888005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.888007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.888009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:09.888012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:09.888070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:09.888079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.888087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:09.888096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:09.888109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:09.888131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812873:4295], now have 1 active actors on pipe
2025-10-01T14:15:09.888138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812476:2446], now have 1 active actors on pipe
2025-10-01T14:15:09.888144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.888146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.888147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.888158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:09.888147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2450
2025-10-01T14:15:09.888171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:09.888158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2450
2025-10-01T14:15:09.888174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:09.888177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:09.888179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:09.888186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:09.888189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:09.888235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.888245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.888261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.888273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:09.888285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:09.888303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:09.888313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:09.888317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:09.888319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:09.888328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:09.888339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:09.888362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.888476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:09.888487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:09.888504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:09.888601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2451 partition: 0 MaxSeqNo: 45 sessionId: src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0
2025-10-01T14:15:09.888883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508621d-e85ad96f-fbac40d7-557eade5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:09.891442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Write session: try to update token
2025-10-01T14:15:09.891456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:09.905678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId: src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:09.907407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:09.907425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:09.907427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:09.907429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:09.907436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.907440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.907442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256692788895210:8123]
2025-10-01T14:15:09.907481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:09.907482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:09.907486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:09.907489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:09.907489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:09.907490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:09.907606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:09.907957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:09.956145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256695165812884:5192]
2025-10-01T14:15:09.956409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2450, pipe: [1:7556256695165812884:5192]
2025-10-01T14:15:10.042841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:10.043115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.043128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.043170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256695165812884:5192], now have 1 active actors on pipe
2025-10-01T14:15:10.043372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:10.043370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:10.043383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256695165812884:5192]
2025-10-01T14:15:10.043419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:10.043429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:10.043484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2451 reason: error at write: Disconnected sessionId: src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0
2025-10-01T14:15:10.043657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2451 sessionId: src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0 is DEAD
2025-10-01T14:15:10.043788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:10.043794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Write session will restart in 0.009975s
2025-10-01T14:15:10.043822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Write session: Do CDS request
2025-10-01T14:15:10.043826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:10.054780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.054859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:10.054877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2452
2025-10-01T14:15:10.054978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.055010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:10.055019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:10.055026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:10.055445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2452 sessionId:  describe result for acl check
2025-10-01T14:15:10.055474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:10.055480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:10.055482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:10.055488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256699460780505:4237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:10.055896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256699460780505:4237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:10.057708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256699460780505:4237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:10.061222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:10.061303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256699460780505:4237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:10.061316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256699460780505:4237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:10.061318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256699460780505:4237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:10.061325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:10.061652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:10.061799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:10.061808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:10.061818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:10.061854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:10.061896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256697083862806:8115]
2025-10-01T14:15:10.062319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:10.062635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:10.062671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:10.063009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:10.063064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.063069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.063070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.063071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.063072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.063073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.063073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.063075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.063075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.063076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.063077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.063079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.063080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.063081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.063086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.063096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.063100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.063103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.063106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.063110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.063114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.063118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.063121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.063125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.063129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.063132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.063136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.063139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.063158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.063165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.063171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.063179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.063183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.063187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.063191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.063197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.063202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.063210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.063215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.063221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.063230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.063236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.063243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.063249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.063256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.063261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.063265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.063273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.063278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.063283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.063290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.063296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.063303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.063308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.063315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.063321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.063360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:10.066833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:10.067550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:10.067565Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:10.067567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:10.067571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:10.067577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2451 [2:7556256697083862806:8115]
2025-10-01T14:15:10.067591Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:10.067611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:10.067617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.067620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.067623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.067638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:10.067647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:10.067656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:10.067716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.067723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.067725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.067728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:10.067731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:10.067796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:10.067803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.067814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.067827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.067846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:10.067868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460780617:4237], now have 1 active actors on pipe
2025-10-01T14:15:10.067876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460780218:2446], now have 1 active actors on pipe
2025-10-01T14:15:10.067883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.067885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.067887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.067900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:10.067918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:10.067917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:10.067920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:10.067922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:10.067936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:10.067939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:10.067965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.067959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2451
2025-10-01T14:15:10.067980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:10.067964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2451
2025-10-01T14:15:10.067985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:10.068245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.068255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.068292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:10.068304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.068313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.068319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:10.068328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.068340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:10.068359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.068497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.068504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.068516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.068593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2452 partition: 0 MaxSeqNo: 45 sessionId: src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0
2025-10-01T14:15:10.068905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|958e9fe2-ab1a882c-87ce3cf4-7ff69a08_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:10.071534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Write session: try to update token
2025-10-01T14:15:10.071548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:10.087517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId: src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:10.088300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:10.088315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:10.088317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:10.088318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:10.088325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.088328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.088331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256697083862800:8115]
2025-10-01T14:15:10.088372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:10.088372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:10.088378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:10.088380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.088381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:10.088382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:10.088504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:10.089826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:10.143535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256699460780629:5192]
2025-10-01T14:15:10.143764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2451, pipe: [1:7556256699460780629:5192]
2025-10-01T14:15:10.224062Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:10.224414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.224425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.224465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460780629:5192], now have 1 active actors on pipe
2025-10-01T14:15:10.224764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256699460780629:5192]
2025-10-01T14:15:10.224775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:10.224796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:10.224779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:10.224791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:10.224825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2452 reason: error at write: Disconnected sessionId: src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0
2025-10-01T14:15:10.224972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2452 sessionId: src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0 is DEAD
2025-10-01T14:15:10.225130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:10.225144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Write session will restart in 0.007523s
2025-10-01T14:15:10.225163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Write session: Do CDS request
2025-10-01T14:15:10.225167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:10.233821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.233897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:10.233914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2453
2025-10-01T14:15:10.234019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.234047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:10.234056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:10.234059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:10.234440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2453 sessionId:  describe result for acl check
2025-10-01T14:15:10.234481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:10.234483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:10.234484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:10.234490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256699460780810:4244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:10.234946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256699460780810:4244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:10.237096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256699460780810:4244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:10.239448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256699460780810:4244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:10.239462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256699460780810:4244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:10.239465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256699460780810:4244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:10.239473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:10.240425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:10.242240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:10.242545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:10.242554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:10.242566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:10.242619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:10.242652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256697083863094:8116]
2025-10-01T14:15:10.243198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:10.243433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:10.243467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:10.243720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:10.243762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.243767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.243768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.243769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.243770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.243771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.243772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.243773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.243774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.243775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.243776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.243777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.243778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.243779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.243784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.243793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.243798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.243802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.243805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.243809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.243813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.243817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.243820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.243824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.243828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.243832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.243835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.243838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.243845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.243852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.243858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.243864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.243873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.243878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.243886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.243891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.243899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.243904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.243911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.243917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.243924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.243929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.243938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.243946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.243951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.243959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.243963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.243969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.243976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.243980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.243985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.243992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.243997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.244005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.244009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.244017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.244046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:10.247295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:10.247916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:10.247930Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:10.247932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:10.247935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:10.247941Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2452 [2:7556256697083863094:8116]
2025-10-01T14:15:10.247954Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:10.247969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:10.247971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.247974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.247977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.247990Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:10.247999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:10.248004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:10.248053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.248059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.248061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.248064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:10.248066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:10.248130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:10.248136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.248148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.248160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.248179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:10.248200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460780631:2446], now have 1 active actors on pipe
2025-10-01T14:15:10.248207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781027:4244], now have 1 active actors on pipe
2025-10-01T14:15:10.248215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.248220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.248223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.248235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:10.248250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:10.248249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:10.248262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:10.248264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:10.248267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:10.248271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:10.248289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.248295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:10.248278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2452
2025-10-01T14:15:10.248279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2452
2025-10-01T14:15:10.248312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:10.248548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.248558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.248588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:10.248598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.248602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.248605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:10.248613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.248621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:10.248634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.248781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.248787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.248800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.248869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2453 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0
2025-10-01T14:15:10.249218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dde08c09-d49e958c-5e6c0bd9-75c07901_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:10.252119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Write session: try to update token
2025-10-01T14:15:10.252139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:10.266531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId: src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:10.269087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:10.269341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.269368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.269390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:10.269393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:10.269396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:10.269397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:10.269406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.269411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.269414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256697083863089:8116]
2025-10-01T14:15:10.269454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:10.269466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:10.269469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:10.269474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:10.269481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.269483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:10.269606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:10.324759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256699460781042:5192]
2025-10-01T14:15:10.325021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2452, pipe: [1:7556256699460781042:5192]
2025-10-01T14:15:10.411399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:10.411798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:10.411848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781042:5192], now have 1 active actors on pipe
2025-10-01T14:15:10.411970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:10.412004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:10.412060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256699460781042:5192]
2025-10-01T14:15:10.412081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:10.412084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:10.412148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2453 reason: error at write: Disconnected sessionId: src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0
2025-10-01T14:15:10.412297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2453 sessionId: src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0 is DEAD
2025-10-01T14:15:10.412393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:10.412400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Write session will restart in 0.007806s
2025-10-01T14:15:10.412418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Write session: Do CDS request
2025-10-01T14:15:10.412425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:10.420900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.420969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:10.420988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2454
2025-10-01T14:15:10.421146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.421182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:10.421192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:10.421200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:10.421578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2454 sessionId:  describe result for acl check
2025-10-01T14:15:10.421608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:10.421611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:10.421613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:10.421618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256699460781213:4210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:10.422105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256699460781213:4210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:10.423990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256699460781213:4210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:10.426563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256699460781213:4210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:10.426580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256699460781213:4210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:10.426583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256699460781213:4210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:10.426591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:10.429940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:10.431970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:10.432282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:10.432297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:10.432311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:10.432367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:10.432407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256697083863414:8094]
2025-10-01T14:15:10.432978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:10.433265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:10.433298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:10.433568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:10.433618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.433623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.433624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.433625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.433626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.433627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.433628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.433629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.433630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.433632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.433632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.433634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.433635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.433636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.433641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.433650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.433653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.433656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.433659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.433662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.433665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.433668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.433671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.433674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.433677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.433680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.433684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.433687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.433693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.433699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.433704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.433712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.433716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.433720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.433724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.433728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.433732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.433735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.433740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.433743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.433747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.433751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.433755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.433758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.433763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.433767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.433771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.433774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.433778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.433781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.433785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.433789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.433793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.433796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.433800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.433832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:10.437370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:10.438308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:10.438321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:10.438323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:10.438325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:10.438330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2453 [2:7556256697083863414:8094]
2025-10-01T14:15:10.438341Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:10.438354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:10.438357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.438359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.438360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.438389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:10.438401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:10.438407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:10.438448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.438454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.438455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.438457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:10.438459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:10.438508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:10.438514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.438521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.438526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.438538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:10.438554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781044:2446], now have 1 active actors on pipe
2025-10-01T14:15:10.438563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.438564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.438565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.438575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:10.438584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781386:4210], now have 1 active actors on pipe
2025-10-01T14:15:10.438590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:10.438593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:10.438597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:10.438599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:10.438601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:10.438603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:10.438626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.438634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:10.438640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:10.438644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2453
2025-10-01T14:15:10.438650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2453
2025-10-01T14:15:10.438700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.438708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.438728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:10.438736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.438739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.438741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:10.438748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.438753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:10.438764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.438900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.438907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.438919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.439006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2454 partition: 0 MaxSeqNo: 45 sessionId: src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0
2025-10-01T14:15:10.439372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b48f5ab-b6b2d152-7e1ecd8f-a110775d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:10.442169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Write session: try to update token
2025-10-01T14:15:10.442190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:10.456608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId: src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:10.458389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:10.458404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:10.458407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:10.458409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:10.458420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.458425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.458429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256697083863409:8094]
2025-10-01T14:15:10.458471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:10.458486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.458488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:10.458619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:10.459061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:10.459206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:10.459218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:10.459222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:10.512171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256699460781458:5192]
2025-10-01T14:15:10.512397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2453, pipe: [1:7556256699460781458:5192]
2025-10-01T14:15:10.600115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:10.600571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.600587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.600626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781458:5192], now have 1 active actors on pipe
2025-10-01T14:15:10.600780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:10.600841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:10.600848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:10.600858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:10.600895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256699460781458:5192]
2025-10-01T14:15:10.600915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2454 reason: error at write: Disconnected sessionId: src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0
2025-10-01T14:15:10.601133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2454 sessionId: src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0 is DEAD
2025-10-01T14:15:10.601292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:10.601301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Write session will restart in 0.007207s
2025-10-01T14:15:10.601321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Write session: Do CDS request
2025-10-01T14:15:10.601325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:10.609857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.609904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:10.609921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2455
2025-10-01T14:15:10.610046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.610075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:10.610086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:10.610089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:10.610476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2455 sessionId:  describe result for acl check
2025-10-01T14:15:10.610514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:10.610521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:10.610523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:10.610528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256699460781574:4208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:10.611032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256699460781574:4208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:10.612788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256699460781574:4208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:10.615582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256699460781574:4208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:10.615600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256699460781574:4208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:10.615603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256699460781574:4208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:10.615611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:10.619645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:10.621895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:10.622073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:10.622083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:10.622093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:10.622139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:10.622176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256697083863716:8088]
2025-10-01T14:15:10.622751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:10.623023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:10.623061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:10.623339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:10.623390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.623396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.623397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.623398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.623399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.623400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.623401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.623402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.623403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.623404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.623405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.623407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.623408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.623409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.623414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.623424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.623428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.623432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.623436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.623440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.623445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.623449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.623452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.623457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.623461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.623469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.623473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.623477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.623484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.623494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.623503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.623512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.623516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.623525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.623529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.623537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.623545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.623550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.623558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.623563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.623571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.623579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.623583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.623591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.623596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.623604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.623608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.623616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.623620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.623628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.623633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.623641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.623645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.623653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.623656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.623661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.623697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:10.627202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:10.627876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:10.627890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:10.627893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:10.627896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:10.627902Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2454 [2:7556256697083863716:8088]
2025-10-01T14:15:10.627921Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:10.627938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:10.627940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.627944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.627946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.627961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:10.627970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:10.627977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:10.628030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.628036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.628037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.628040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:10.628043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:10.628103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:10.628109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.628121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.628136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.628155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:10.628176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781783:4208], now have 1 active actors on pipe
2025-10-01T14:15:10.628182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781463:2446], now have 1 active actors on pipe
2025-10-01T14:15:10.628188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.628193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.628195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.628210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:10.628222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:10.628226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:10.628230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:10.628233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:10.628238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:10.628241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:10.628220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2454
2025-10-01T14:15:10.628222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2454
2025-10-01T14:15:10.628279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.628287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.628300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.628310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:10.628315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:10.628335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:10.628344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.628351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.628353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:10.628361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.628372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:10.628395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.628520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.628526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.628546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.628620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2455 partition: 0 MaxSeqNo: 45 sessionId: src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0
2025-10-01T14:15:10.628937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f4d4a3-b0ff2f39-754e5003-3c57e41b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:10.631626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Write session: try to update token
2025-10-01T14:15:10.631642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:10.644977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId: src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:10.647009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:10.647818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.647839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.647860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:10.647863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:10.647865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:10.647867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:10.647875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.647883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.647887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256697083863711:8088]
2025-10-01T14:15:10.647914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:10.647924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:10.647926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:10.647936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:10.647943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.647949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:10.648065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:10.701092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256699460781881:5192]
2025-10-01T14:15:10.701344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2454, pipe: [1:7556256699460781881:5192]
2025-10-01T14:15:10.787974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:10.788280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:10.788339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781881:5192], now have 1 active actors on pipe
2025-10-01T14:15:10.788396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:10.788499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256699460781881:5192]
2025-10-01T14:15:10.788534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:10.797955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:10.797972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:10.797989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2455 reason: error at write: Disconnected sessionId: src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0
2025-10-01T14:15:10.798120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2455 sessionId: src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0 is DEAD
2025-10-01T14:15:10.798250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:10.798262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Write session will restart in 0.006899s
2025-10-01T14:15:10.798287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Write session: Do CDS request
2025-10-01T14:15:10.798296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:10.805950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.806077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:10.806094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2456
2025-10-01T14:15:10.806204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:10.806234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:10.806243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:10.806250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:10.806638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2456 sessionId:  describe result for acl check
2025-10-01T14:15:10.806670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:10.806675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:10.806677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:10.806682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256699460782161:4188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:10.807172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256699460782161:4188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:10.810072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256699460782161:4188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:10.811505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:10.813698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:10.813988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:10.814000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:10.814010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:10.814052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:10.814081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256697083864006:8090]
2025-10-01T14:15:10.814100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256699460782161:4188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:10.814116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256699460782161:4188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:10.814123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256699460782161:4188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:10.814131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:10.814551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:10.814781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:10.814817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:10.815102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:10.815152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.815158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.815159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.815161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.815162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.815163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.815164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.815165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.815166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.815167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.815168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.815169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.815170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.815171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.815175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.815185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.815189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.815192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.815196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.815199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.815203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.815207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.815210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.815214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.815218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.815221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.815228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.815232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.815242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.815249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:10.815259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.815268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:10.815272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.815277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:10.815280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.815285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:10.815289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.815298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:10.815306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.815311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:10.815319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.815324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:10.815331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.815337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:10.815345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.815350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:10.815357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.815361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.815369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.815373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.815378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.815386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.815393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.815398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:10.815406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.815414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:10.815453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:10.818755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:10.819637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:10.819651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:10.819652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:10.819654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:10.819659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2455 [2:7556256697083864006:8090]
2025-10-01T14:15:10.819669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:10.819681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:10.819687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.819689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.819691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.819701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:10.819707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:10.819713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:10.819761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.819768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.819770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.819772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:10.819774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:10.819824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:10.819830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.819837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:10.819842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:10.819851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:10.819871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.819877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.819879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.819888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:10.819898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:10.819903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460782286:4188], now have 1 active actors on pipe
2025-10-01T14:15:10.819905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:10.819907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460781883:2446], now have 1 active actors on pipe
2025-10-01T14:15:10.819907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:10.819913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:10.819926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:10.819933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:10.819955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.819949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2455
2025-10-01T14:15:10.819967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:10.819953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2455
2025-10-01T14:15:10.819978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:10.820002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.820011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.820033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54515100-133c9822-a9ffd7ed-c7e000af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:10.820043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:10.820052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:10.820058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:10.820065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:10.820077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:10.820092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.820235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.820243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.820255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:10.820324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2456 partition: 0 MaxSeqNo: 45 sessionId: src_id|54515100-133c9822-a9ffd7ed-c7e000af_0
2025-10-01T14:15:10.820671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4140366-fc5d7492-15bc47ce-4c5df998_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54515100-133c9822-a9ffd7ed-c7e000af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:10.823474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Write session: try to update token
2025-10-01T14:15:10.823496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:10.830281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:10.830299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:10.830307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.830346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:10.830360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:10.830567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:10.830720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:10.830874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:10.831027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:10.831233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:10.831276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:10.838053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId: src_id|54515100-133c9822-a9ffd7ed-c7e000af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:10.840615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:10.840807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.840828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.840865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:10.840944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:10.848682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:10.848702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:10.848704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:10.848705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:10.848714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.848717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.848720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256697083864001:8090]
2025-10-01T14:15:10.848757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:10.848762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:10.848764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:10.848768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:10.848774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:10.848788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:10.848877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:10.888496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256699460782297:5192]
2025-10-01T14:15:10.888766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2455, pipe: [1:7556256699460782297:5192]
2025-10-01T14:15:10.990930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:10.997910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:10.997932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:10.998055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.998106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:10.998160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:10.998211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:10.998256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:10.998265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:10.998324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.998397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:10.998454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:10.998515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:10.998557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:10.998562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:10.998624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.998677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:10.998734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:10.998795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:10.998841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:10.998847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:10.998910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.998968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:10.999032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:10.999087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:10.999127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:10.999132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:10.999194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.999325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:10.999443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:10.999500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:10.999546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:10.999552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:10.999611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.999669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:10.999731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:10.999788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:10.999835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:10.999843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:10.999903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:10.999959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:11.000021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:11.000081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:11.000120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:11.000128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:11.000198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:11.000258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:11.000327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:11.000396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:11.000454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:11.000460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:11.000526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:11.000596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:11.000655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:11.000713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:11.000754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:11.000759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:11.000819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:11.000880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:11.000943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:11.001003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:11.001062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:11.001069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:11.001113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256699460782297:5192], now have 1 active actors on pipe
2025-10-01T14:15:11.001333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:11.001350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:11.001373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2456 reason: error at write: Disconnected sessionId: src_id|54515100-133c9822-a9ffd7ed-c7e000af_0
2025-10-01T14:15:11.001563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2456 sessionId: src_id|54515100-133c9822-a9ffd7ed-c7e000af_0 is DEAD
2025-10-01T14:15:11.001713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:11.001727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Write session will restart in 0.008037s
2025-10-01T14:15:11.001753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Write session: Do CDS request
2025-10-01T14:15:11.001760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:11.001750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:11.001794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256699460782297:5192]
2025-10-01T14:15:11.002045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:11.010901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.010938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:11.010953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2457
2025-10-01T14:15:11.011076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.011100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:11.011102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:11.011105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:11.011335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2457 sessionId:  describe result for acl check
2025-10-01T14:15:11.011368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:11.011372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:11.011374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:11.011377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256703755749770:4154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:11.011692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256703755749770:4154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:11.013462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256703755749770:4154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:11.015736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256703755749770:4154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:11.015751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256703755749770:4154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:11.015753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256703755749770:4154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:11.015760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:11.018447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:11.020354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:11.020502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:11.020511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:11.020522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:11.020573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:11.020609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256701378831599:8084]
2025-10-01T14:15:11.021145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:11.021365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:11.021390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:11.021621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:11.021682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.021688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.021689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.021690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.021691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.021692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.021693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.021694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.021695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.021696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.021698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.021699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.021700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.021701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.021706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.021715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.021719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.021722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.021726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.021730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.021734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.021738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.021741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.021745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.021748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.021752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.021755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.021758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.021771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.021783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.021791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.021800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.021804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.021810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.021813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.021818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.021822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.021827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.021831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.021835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.021841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.021846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.021854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.021859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.021867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.021873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.021876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.021885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.021888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.021893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.021898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.021902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.021909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.021913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.021917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.021925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.021959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:11.025229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:11.026042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:11.026054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:11.026056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:11.026060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:11.026065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2456 [2:7556256701378831599:8084]
2025-10-01T14:15:11.026079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:11.026095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:11.026101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.026104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.026106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.026120Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:11.026128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:11.026135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:11.026184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.026190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.026192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.026194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:11.026197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:11.026251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:11.026256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.026263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.026276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.026295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:11.026314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755749611:2446], now have 1 active actors on pipe
2025-10-01T14:15:11.026321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755749957:4154], now have 1 active actors on pipe
2025-10-01T14:15:11.026328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.026331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.026333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.026347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:11.026361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:11.026364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:11.026380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:11.026382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:11.026394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:11.026401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:11.026387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2456
2025-10-01T14:15:11.026424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.026431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:11.026433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:11.026431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2456
2025-10-01T14:15:11.026467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.026476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.026503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:11.026513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.026517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.026519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:11.026526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.026538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:11.026553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.026688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.026695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.026708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.026792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2457 partition: 0 MaxSeqNo: 45 sessionId: src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0
2025-10-01T14:15:11.027137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54515100-133c9822-a9ffd7ed-c7e000af_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:11.029747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Write session: try to update token
2025-10-01T14:15:11.029762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:11.042700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId: src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:11.044852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:11.045614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.045643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.045664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:11.045672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:11.045674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:11.045676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:11.045684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.045688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.045692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256701378831594:8084]
2025-10-01T14:15:11.045737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:11.045749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:11.045750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:11.045753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:11.045756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.045759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:11.045884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:11.101978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256703755750044:5192]
2025-10-01T14:15:11.102239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2456, pipe: [1:7556256703755750044:5192]
2025-10-01T14:15:11.190150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:11.190518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:11.190576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750044:5192], now have 1 active actors on pipe
2025-10-01T14:15:11.190637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:11.190788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:11.190857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256703755750044:5192]
2025-10-01T14:15:11.200016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:11.200032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:11.200052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2457 reason: error at write: Disconnected sessionId: src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0
2025-10-01T14:15:11.200177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2457 sessionId: src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0 is DEAD
2025-10-01T14:15:11.200308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:11.200320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Write session will restart in 0.008719s
2025-10-01T14:15:11.200345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Write session: Do CDS request
2025-10-01T14:15:11.200354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:11.209917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.210353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:11.210389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2458
2025-10-01T14:15:11.210498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.210529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:11.210541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:11.210544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:11.210942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2458 sessionId:  describe result for acl check
2025-10-01T14:15:11.210975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:11.210981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:11.210983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:11.210988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256703755750396:4141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:11.211461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256703755750396:4141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:11.213630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256703755750396:4141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:11.215765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:11.216149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256703755750396:4141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:11.216163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256703755750396:4141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:11.216166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256703755750396:4141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:11.216178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:11.216213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:11.216380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:11.216390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:11.216401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:11.216441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:11.216477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256701378831899:8076]
2025-10-01T14:15:11.217053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:11.217345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:11.217382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:11.217607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:11.217650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.217654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.217655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.217656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.217656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.217657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.217658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.217658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.217659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.217660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.217660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.217661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.217662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.217662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.217666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.217672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.217674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.217676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.217678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.217680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.217682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.217684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.217687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.217689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.217691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.217693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.217695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.217697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.217702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.217707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.217710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.217713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.217716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.217718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.217721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.217724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.217726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.217729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.217732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.217735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.217737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.217740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.217743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.217746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.217748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.217752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.217756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.217761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.217764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.217769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.217773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.217778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.217782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.217787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.217789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.217792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.217814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:11.221393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:11.222308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:11.222322Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:11.222323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:11.222326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:11.222330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2457 [2:7556256701378831899:8076]
2025-10-01T14:15:11.222343Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:11.222356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:11.222358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.222360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.222361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.222384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:11.222389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:11.222395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:11.222451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.222459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.222461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.222464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:11.222466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:11.222537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:11.222546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.222558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.222569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.222585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:11.222604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750450:4141], now have 1 active actors on pipe
2025-10-01T14:15:11.222613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750047:2446], now have 1 active actors on pipe
2025-10-01T14:15:11.222620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.222622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.222624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.222638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:11.222654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:11.222666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:11.222669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:11.222671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:11.222674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:11.222677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:11.222668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2457
2025-10-01T14:15:11.222695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.222704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:11.222714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:11.222729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.222707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2457
2025-10-01T14:15:11.222734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.222766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:11.222778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.222789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.222798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:11.222810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.222822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:11.222847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.222962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.222969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.222985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.223055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2458 partition: 0 MaxSeqNo: 45 sessionId: src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0
2025-10-01T14:15:11.223445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc92341-fb098a5f-a8eb682f-70dfe2ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:11.226251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Write session: try to update token
2025-10-01T14:15:11.226270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:11.242241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId: src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:11.243086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:11.243114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:11.243116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:11.243119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:11.243132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.243137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.243143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256701378831893:8076]
2025-10-01T14:15:11.243196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:11.243207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:11.243209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:11.243213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:11.243215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.243222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:11.243406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:11.244729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:11.291004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256703755750462:5192]
2025-10-01T14:15:11.291223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2457, pipe: [1:7556256703755750462:5192]
2025-10-01T14:15:11.390187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:11.390512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.390535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.390572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750462:5192], now have 1 active actors on pipe
2025-10-01T14:15:11.390731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256703755750462:5192]
2025-10-01T14:15:11.390750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:11.390755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:11.390768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:11.390816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2458 reason: error at write: Disconnected sessionId: src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0
2025-10-01T14:15:11.390796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:11.391143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:11.391154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Write session will restart in 0.009606s
2025-10-01T14:15:11.391177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Write session: Do CDS request
2025-10-01T14:15:11.391185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:11.391011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2458 sessionId: src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0 is DEAD
2025-10-01T14:15:11.401906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.401992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:11.402008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2459
2025-10-01T14:15:11.402159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.402191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:11.402201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:11.402204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:11.402522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2459 sessionId:  describe result for acl check
2025-10-01T14:15:11.402552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:11.402558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:11.402559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:11.402563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256703755750682:4132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:11.402985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256703755750682:4132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:11.405217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256703755750682:4132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:11.407627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256703755750682:4132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:11.407643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256703755750682:4132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:11.407647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256703755750682:4132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:11.407658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:11.410546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:11.412962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:11.413256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:11.413264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:11.413273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:11.413325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:11.413355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256701378832225:8062]
2025-10-01T14:15:11.413767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:11.414050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:11.414083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:11.414301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:11.414346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.414350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.414351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.414352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.414352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.414353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.414354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.414364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.414365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.414366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.414381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.414382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.414383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.414384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.414389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.414399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.414403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.414407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.414410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.414412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.414414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.414416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.414418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.414420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.414422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.414423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.414426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.414428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.414433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.414437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.414441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.414444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.414446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.414449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.414451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.414453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.414456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.414459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.414461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.414464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.414467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.414469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.414471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.414474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.414477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.414479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.414481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.414485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.414488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.414490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.414492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.414495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.414497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.414500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.414502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.414507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.414544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:11.418169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:11.419157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:11.419172Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:11.419174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:11.419178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:11.419185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2458 [2:7556256701378832225:8062]
2025-10-01T14:15:11.419200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:11.419217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:11.419228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.419232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.419235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.419250Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:11.419256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:11.419266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:11.419327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.419337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.419340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.419343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:11.419346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:11.419411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:11.419418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.419430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.419443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.419460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:11.419483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750838:4132], now have 1 active actors on pipe
2025-10-01T14:15:11.419491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750468:2446], now have 1 active actors on pipe
2025-10-01T14:15:11.419498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.419504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.419507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.419519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:11.419538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:11.419544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:11.419547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:11.419549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:11.419553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:11.419556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:11.419583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.419586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:11.419589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:11.419611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.419615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.419564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2458
2025-10-01T14:15:11.419644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:11.419604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2458
2025-10-01T14:15:11.419657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.419661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.419663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:11.419672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.419683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:11.419700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.419856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.419867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.419889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.419985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2459 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0
2025-10-01T14:15:11.420325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e46abc-7038e9f-5c90f617-c5abb5a2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:11.423027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Write session: try to update token
2025-10-01T14:15:11.423046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:11.437260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId: src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:11.439315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:11.439338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:11.439341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:11.439343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:11.439357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.439361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.439365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256701378832220:8062]
2025-10-01T14:15:11.439407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:11.439416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:11.439421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:11.439423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.439425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:11.439426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:11.439571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:11.439590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:11.491129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256703755750890:5192]
2025-10-01T14:15:11.491434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2458, pipe: [1:7556256703755750890:5192]
2025-10-01T14:15:11.581871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:11.582253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.582265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.582299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750890:5192], now have 1 active actors on pipe
2025-10-01T14:15:11.582464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:11.582525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:11.582589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256703755750890:5192]
2025-10-01T14:15:11.582615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0
2025-10-01T14:15:11.582626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:11.582795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2459 sessionId: src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0 is DEAD
2025-10-01T14:15:11.582960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:11.582970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Write session will restart in 0.006216s
2025-10-01T14:15:11.582992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Write session: Do CDS request
2025-10-01T14:15:11.582998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:11.589773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.589910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:11.589923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2460
2025-10-01T14:15:11.590054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.590078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:11.590081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:11.590084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:11.590411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2460 sessionId:  describe result for acl check
2025-10-01T14:15:11.590442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:11.590444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:11.590445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:11.590448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256703755750978:4130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:11.590848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256703755750978:4130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:11.592837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256703755750978:4130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:11.596087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256703755750978:4130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:11.596101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256703755750978:4130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:11.596104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256703755750978:4130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:11.596112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:11.602185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:11.602644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:11.602825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:11.602835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:11.602847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:11.602885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:11.602914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256701378832520:8059]
2025-10-01T14:15:11.603308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:11.603532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:11.603560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:11.603812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:11.603896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.603906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.603907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.603908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.603909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.603911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.603912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.603913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.603914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.603915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.603917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.603918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.603919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.603920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.603926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.603936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.603940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.603945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.603948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.603952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.603955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.603959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.603963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.603968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.603972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.603976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.603979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.603983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.603996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.604009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.604015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.604020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.604026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.604035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.604040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.604050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.604056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.604064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.604075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.604081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.604092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.604098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.604106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.604111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.604124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.604134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.604141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.604151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.604156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.604164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.604168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.604179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.604184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.604193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.604197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.604201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.604243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:11.607855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:11.608900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:11.608912Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:11.608914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:11.608917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:11.608924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2459 [2:7556256701378832520:8059]
2025-10-01T14:15:11.608940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:11.608957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:11.608961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.608965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.608967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.608983Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:11.608988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:11.608994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:11.609051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.609059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.609060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.609064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:11.609066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:11.609122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:11.609128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.609136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.609146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.609162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:11.609183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755751205:4130], now have 1 active actors on pipe
2025-10-01T14:15:11.609191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755750896:2446], now have 1 active actors on pipe
2025-10-01T14:15:11.609198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.609203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.609205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.609217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:11.609225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:11.609229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:11.609232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:11.609233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:11.609242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:11.609245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:11.609271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.609249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2459
2025-10-01T14:15:11.609279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:11.609253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2459
2025-10-01T14:15:11.609280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:11.609305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.609313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.609339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1872d26-f91887b-f7e63863-59c8aca2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:11.609349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.609353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.609356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:11.609364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.609375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:11.609398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.609526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.609540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.609562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.609633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2460 partition: 0 MaxSeqNo: 45 sessionId: src_id|a1872d26-f91887b-f7e63863-59c8aca2_0
2025-10-01T14:15:11.609953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce975d8-d378aa30-46e0cf54-31689b3d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a1872d26-f91887b-f7e63863-59c8aca2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:11.612569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Write session: try to update token
2025-10-01T14:15:11.612582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:11.625120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId: src_id|a1872d26-f91887b-f7e63863-59c8aca2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:11.627303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:11.628939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.628961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.628981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:11.628984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:11.628987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:11.628988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:11.628996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.629000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.629004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256701378832515:8059]
2025-10-01T14:15:11.629049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:11.629051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:11.629055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.629057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:11.629061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:11.629065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:11.629168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:11.682608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256703755751318:5192]
2025-10-01T14:15:11.682845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2459, pipe: [1:7556256703755751318:5192]
2025-10-01T14:15:11.769372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:11.769640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:11.769692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755751318:5192], now have 1 active actors on pipe
2025-10-01T14:15:11.769784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:11.769881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:11.769887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:11.769890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:11.769939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256703755751318:5192]
2025-10-01T14:15:11.769953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2460 reason: error at write: Disconnected sessionId: src_id|a1872d26-f91887b-f7e63863-59c8aca2_0
2025-10-01T14:15:11.770118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2460 sessionId: src_id|a1872d26-f91887b-f7e63863-59c8aca2_0 is DEAD
2025-10-01T14:15:11.770244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:11.770255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Write session will restart in 0.009582s
2025-10-01T14:15:11.770279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Write session: Do CDS request
2025-10-01T14:15:11.770284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:11.780916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.780982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:11.781002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2461
2025-10-01T14:15:11.781169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.781218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:11.781228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:11.781231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:11.781553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2461 sessionId:  describe result for acl check
2025-10-01T14:15:11.781591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:11.781599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:11.781601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:11.781606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256703755751532:4117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:11.782105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256703755751532:4117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:11.784316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256703755751532:4117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:11.786507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256703755751532:4117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:11.786522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256703755751532:4117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:11.786525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256703755751532:4117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:11.786533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:11.790365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:11.790794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:11.790990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:11.791000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:11.791011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:11.791057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:11.791092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256701378832828:8055]
2025-10-01T14:15:11.791691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:11.791954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:11.792009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:11.792300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:11.792351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.792357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.792358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.792359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.792360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.792361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.792362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.792364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.792365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.792367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.792368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.792369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.792370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.792371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.792376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.792386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.792390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.792394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.792398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.792405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.792409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.792417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.792421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.792425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.792429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.792436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.792439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.792446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.792452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.792462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.792472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.792481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.792488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.792497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.792504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.792509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.792518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.792526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.792534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.792549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.792557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.792562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.792570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.792575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.792583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.792588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.792594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.792599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.792608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.792618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.792626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.792634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.792640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.792649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.792653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.792661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.792696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:11.796134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:11.796997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:11.797012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:11.797014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:11.797017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:11.797024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2460 [2:7556256701378832828:8055]
2025-10-01T14:15:11.797039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:11.797061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:11.797068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.797071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.797074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.797092Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:11.797102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:11.797113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:11.797168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.797175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.797178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.797181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:11.797184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:11.797249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:11.797260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.797269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.797280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.797296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:11.797320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755751321:2446], now have 1 active actors on pipe
2025-10-01T14:15:11.797328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755751725:4117], now have 1 active actors on pipe
2025-10-01T14:15:11.797336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.797342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.797344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.797358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:11.797343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2460
2025-10-01T14:15:11.797374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:11.797357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2460
2025-10-01T14:15:11.797382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:11.797385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:11.797387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:11.797387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:11.797390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:11.797436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.797448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:11.797463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.797463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:11.797472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.797515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:11.797526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.797530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.797532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:11.797539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.797548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:11.797568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.797714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.797722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.797736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.797807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2461 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0
2025-10-01T14:15:11.798167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1872d26-f91887b-f7e63863-59c8aca2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:11.801051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Write session: try to update token
2025-10-01T14:15:11.801068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:11.815122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId: src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:11.817617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:11.817847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.817871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.817892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:11.817895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:11.817897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:11.817899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:11.817908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.817913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.817916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256701378832823:8055]
2025-10-01T14:15:11.817951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:11.817965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:11.817969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:11.817969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:11.817975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.817977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:11.818089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:11.869988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256703755751739:5192]
2025-10-01T14:15:11.870277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2460, pipe: [1:7556256703755751739:5192]
2025-10-01T14:15:11.950966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:11.951214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:11.951263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755751739:5192], now have 1 active actors on pipe
2025-10-01T14:15:11.951297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:11.951419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:11.951460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256703755751739:5192]
2025-10-01T14:15:11.962256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:11.962275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:11.962299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2461 reason: error at write: Disconnected sessionId: src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0
2025-10-01T14:15:11.962486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2461 sessionId: src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0 is DEAD
2025-10-01T14:15:11.962613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:11.962624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Write session will restart in 0.005103s
2025-10-01T14:15:11.962651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Write session: Do CDS request
2025-10-01T14:15:11.962658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:11.968897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.968952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:11.968969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2462
2025-10-01T14:15:11.969076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:11.969107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:11.969118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:11.969122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:11.969493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2462 sessionId:  describe result for acl check
2025-10-01T14:15:11.969524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:11.969530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:11.969532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:11.969536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256703755752080:4116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:11.970017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256703755752080:4116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:11.972601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256703755752080:4116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:11.974109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:11.974532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:11.974848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256703755752080:4116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:11.974867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256703755752080:4116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:11.974867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:11.974869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256703755752080:4116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:11.974876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:11.974891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:11.974909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:11.974973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:11.975012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256701378833126:8044]
2025-10-01T14:15:11.975381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:11.975584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:11.975609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:11.975787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:11.975820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.975824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.975824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.975825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.975826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.975826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.975827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.975828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.975828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.975829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.975830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.975830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.975831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.975831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.975834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.975840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.975842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.975844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.975846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.975848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.975850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.975852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.975854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.975857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.975859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.975861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.975863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.975865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.975871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.975875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:11.975879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.975881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:11.975884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.975886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:11.975889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.975891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:11.975894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.975897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:11.975899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.975902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:11.975905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.975911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:11.975913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.975915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:11.975918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.975921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:11.975924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.975926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.975932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.975934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.975936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.975939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.975944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.975947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:11.975949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.975954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:11.975974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:11.979535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:11.980575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:11.980588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:11.980590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:11.980592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:11.980597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2461 [2:7556256701378833126:8044]
2025-10-01T14:15:11.980608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:11.980621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:11.980623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.980625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.980626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.980637Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:11.980641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:11.980645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:11.980695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.980702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.980703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.980705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:11.980707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:11.980752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:11.980757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:11.980765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:11.980771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:11.980780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:11.980793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755752148:4116], now have 1 active actors on pipe
2025-10-01T14:15:11.980798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256703755751744:2446], now have 1 active actors on pipe
2025-10-01T14:15:11.980803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:11.980804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:11.980806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:11.980815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:11.980823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:11.980824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:11.980831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:11.980832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:11.980833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:11.980834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:11.980856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:11.980866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:11.980896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:11.980890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2461
2025-10-01T14:15:11.980893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2461
2025-10-01T14:15:11.980934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.980941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.980959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:11.980969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:11.980974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:11.980980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:11.980987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:11.980995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:11.981011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.981119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:11.981128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:11.981141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:11.981208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2462 partition: 0 MaxSeqNo: 45 sessionId: src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0
2025-10-01T14:15:11.981562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5676a7-5c53e9ad-3c4e8363-a2055865_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:11.984299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Write session: try to update token
2025-10-01T14:15:11.984317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:11.991856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:11.991879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:11.991889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:11.991925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:11.991935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:11.992096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:11.992249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:11.992384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:11.992518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:11.992751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:11.992794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:12.000859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId: src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:12.003416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:12.003609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.003628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.003659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:12.003754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:12.009639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:12.009656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.009658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:12.009659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:12.009667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:12.009670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:12.009676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256701378833121:8044]
2025-10-01T14:15:12.009712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:12.009719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.009726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:12.009726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:12.009732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:12.009735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:12.009839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:12.051769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256708050719483:5192]
2025-10-01T14:15:12.052075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2461, pipe: [1:7556256708050719483:5192]
2025-10-01T14:15:12.141698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:12.148292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.148316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.148449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.148496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.148558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.148607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.148717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.148725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.148782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.148839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.148885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.148934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.148974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.148979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.149034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.149093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.149145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.149198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.149238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.149243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.149298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.149352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.149402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.149450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.149491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.149496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.149549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.149600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.149649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.149701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.149738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.149743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.149797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.149848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.149901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.149954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.149992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.149997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.150054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.150103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.150155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.150208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.150246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.150251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.150305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.150366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.150447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.150498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.150535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.150539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.150599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.150649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.150701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.150754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.150792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.150797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.150857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.150906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.150957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.151007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.151047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.151051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.151089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050719483:5192], now have 1 active actors on pipe
2025-10-01T14:15:12.151331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:12.151331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:12.151335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:12.151357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2462 reason: error at write: Disconnected sessionId: src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0
2025-10-01T14:15:12.151402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256708050719483:5192]
2025-10-01T14:15:12.151509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2462 sessionId: src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0 is DEAD
2025-10-01T14:15:12.151652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:12.151664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Write session will restart in 0.008338s
2025-10-01T14:15:12.151687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Write session: Do CDS request
2025-10-01T14:15:12.151692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:12.151795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:12.160883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.160921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:12.160939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2463
2025-10-01T14:15:12.161070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.161102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:12.161113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:12.161121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:12.161534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2463 sessionId:  describe result for acl check
2025-10-01T14:15:12.161571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:12.161578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:12.161580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:12.161586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256708050719674:4064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:12.162057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256708050719674:4064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:12.164484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256708050719674:4064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:12.167333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256708050719674:4064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:12.167346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256708050719674:4064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:12.167349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256708050719674:4064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:12.167357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:12.168798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:12.170995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:12.171392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:12.171404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:12.171417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:12.171469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:12.171511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256705673800728:8041]
2025-10-01T14:15:12.172084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:12.172336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:12.172380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:12.172703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:12.172774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.172781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.172782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.172783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.172785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.172786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.172787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.172788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.172789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.172791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.172792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.172793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.172794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.172796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.172801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.172812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.172821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.172829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.172837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.172841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.172845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.172849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.172857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.172865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.172869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.172873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.172877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.172880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.172888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.172900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.172910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.172920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.172929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.172939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.172948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.172953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.172961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.172971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.172979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.172988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.172997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.173006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.173015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.173024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.173033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.173043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.173051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.173056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.173066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.173075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.173083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.173091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.173100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.173108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.173117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.173125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.173167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:12.176632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:12.177488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:12.177499Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:12.177500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:12.177503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:12.177508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2462 [2:7556256705673800728:8041]
2025-10-01T14:15:12.177521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:12.177533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:12.177538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.177541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.177542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.177554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:12.177561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:12.177565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:12.177607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.177612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.177613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.177616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:12.177617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:12.177666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:12.177673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.177680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.177686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.177695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:12.177709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050719904:4064], now have 1 active actors on pipe
2025-10-01T14:15:12.177711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050719498:2446], now have 1 active actors on pipe
2025-10-01T14:15:12.177716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.177717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.177719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.177728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:12.177737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:12.177743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:12.177746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:12.177746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:12.177748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:12.177749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:12.177768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.177777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:12.177784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:12.177797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2462
2025-10-01T14:15:12.177873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2462
2025-10-01T14:15:12.178057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.178066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.178085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53465497-81b51106-ef64dc48-d5445e56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:12.178095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.178098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.178099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:12.178106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.178113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:12.178126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.178283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.178294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.178314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.178395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2463 partition: 0 MaxSeqNo: 45 sessionId: src_id|53465497-81b51106-ef64dc48-d5445e56_0
2025-10-01T14:15:12.178757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5013498-e16c9a53-ba4262e1-5ade172b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53465497-81b51106-ef64dc48-d5445e56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:12.181319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Write session: try to update token
2025-10-01T14:15:12.181333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:12.197198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId: src_id|53465497-81b51106-ef64dc48-d5445e56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:12.197456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:12.197476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.197479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:12.197481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:12.197489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.197494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.197498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256705673800723:8041]
2025-10-01T14:15:12.197544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:12.197546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:12.197552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.197554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:12.197555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:12.197557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:12.197690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:12.199721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:12.251421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256708050719919:5192]
2025-10-01T14:15:12.251661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2462, pipe: [1:7556256708050719919:5192]
2025-10-01T14:15:12.333628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:12.334030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.334041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.334072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050719919:5192], now have 1 active actors on pipe
2025-10-01T14:15:12.334240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:12.334269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:12.334298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:12.334324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256708050719919:5192]
2025-10-01T14:15:12.334356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2463 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53465497-81b51106-ef64dc48-d5445e56_0
2025-10-01T14:15:12.334533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2463 sessionId: src_id|53465497-81b51106-ef64dc48-d5445e56_0 is DEAD
2025-10-01T14:15:12.334704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:12.334715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Write session will restart in 0.005050s
2025-10-01T14:15:12.334739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Write session: Do CDS request
2025-10-01T14:15:12.334745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:12.340888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.340942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:12.340959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2464
2025-10-01T14:15:12.341097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.341134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:12.341143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:12.341146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:12.341523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2464 sessionId:  describe result for acl check
2025-10-01T14:15:12.341559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:12.341565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:12.341567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:12.341571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256708050719996:4045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:12.342119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256708050719996:4045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:12.344231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256708050719996:4045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:12.346952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256708050719996:4045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:12.346967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256708050719996:4045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:12.346970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256708050719996:4045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:12.346976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:12.351139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:12.353471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:12.353635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:12.353643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:12.353650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:12.353681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:12.353710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256705673801031:8034]
2025-10-01T14:15:12.354114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:12.354307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:12.354332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:12.354538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:12.354573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.354577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.354578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.354579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.354579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.354580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.354581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.354582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.354583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.354583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.354584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.354585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.354586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.354586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.354589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.354596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.354598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.354600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.354602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.354604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.354606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.354608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.354610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.354613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.354615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.354617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.354619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.354621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.354626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.354631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.354634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.354637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.354640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.354642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.354645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.354648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.354650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.354653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.354656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.354659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.354662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.354664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.354666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.354669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.354672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.354674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.354677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.354680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.354682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.354685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.354688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.354690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.354693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.354696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.354699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.354702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.354739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:12.358168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:12.358788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:12.358808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:12.358810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:12.358813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:12.358818Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2463 [2:7556256705673801031:8034]
2025-10-01T14:15:12.358830Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:12.358844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:12.358851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.358854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.358855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.358867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:12.358874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:12.358879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:12.358920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.358925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.358926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.358929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:12.358931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:12.358993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:12.359002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.359010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.359016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.359025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:12.359038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050720242:4045], now have 1 active actors on pipe
2025-10-01T14:15:12.359044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050719921:2446], now have 1 active actors on pipe
2025-10-01T14:15:12.359050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.359051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.359053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.359062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:12.359074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:12.359075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:12.359078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:12.359090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:12.359091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:12.359098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:12.359134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.359146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:12.359148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:12.359133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2463
2025-10-01T14:15:12.359186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2463
2025-10-01T14:15:12.359242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.359250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.359266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|926364c5-3f3a5dd6-69602a-81c6940c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:12.359274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.359277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.359278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:12.359285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.359294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:12.359305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.359432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.359443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.359468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.359553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2464 partition: 0 MaxSeqNo: 45 sessionId: src_id|926364c5-3f3a5dd6-69602a-81c6940c_0
2025-10-01T14:15:12.359848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53465497-81b51106-ef64dc48-d5445e56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|926364c5-3f3a5dd6-69602a-81c6940c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:12.362547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Write session: try to update token
2025-10-01T14:15:12.362561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:12.369415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:12.369434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.369441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.369473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:12.369477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:12.369615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:12.369741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:12.369859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:12.369984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:12.370160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:12.370190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:12.376857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId: src_id|926364c5-3f3a5dd6-69602a-81c6940c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:12.379432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:12.380027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.380044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.380071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:12.380146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:12.386964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:12.386984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.386986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:12.386987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:12.386997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.387000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.387002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256705673801026:8034]
2025-10-01T14:15:12.387040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:12.387052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.387051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:12.387054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:12.387056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:12.387059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:12.387167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:12.434711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256708050720343:5192]
2025-10-01T14:15:12.434923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2463, pipe: [1:7556256708050720343:5192]
2025-10-01T14:15:12.520917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:12.527869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.527893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.528028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.528079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.528130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.528180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.528220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.528228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.528281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.528332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.528383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.528435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.528476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.528481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.528553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.528610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.528664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.528722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.528766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.528774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.528836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.528889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.528946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.528999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.529039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.529045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.529100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.529155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.529210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.529262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.529308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.529316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.529381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.529432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.529485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.529544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.529582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.529588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.529646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.529695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.529751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.529812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.529856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.529861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.529914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.529963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.530018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.530077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.530115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.530121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.530179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.530230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.530285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.530351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.530411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.530417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.530471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.530531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.530598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.530662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.530769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.530778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.530827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050720343:5192], now have 1 active actors on pipe
2025-10-01T14:15:12.531043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:12.531048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256708050720343:5192]
2025-10-01T14:15:12.531058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:12.531066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:12.531079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2464 reason: error at write: Disconnected sessionId: src_id|926364c5-3f3a5dd6-69602a-81c6940c_0
2025-10-01T14:15:12.531216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2464 sessionId: src_id|926364c5-3f3a5dd6-69602a-81c6940c_0 is DEAD
2025-10-01T14:15:12.531381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:12.531389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Write session will restart in 0.008260s
2025-10-01T14:15:12.531414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Write session: Do CDS request
2025-10-01T14:15:12.531420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:12.531724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:12.540872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.540940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:12.540956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2465
2025-10-01T14:15:12.541083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.541116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:12.541127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:12.541133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:12.541502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2465 sessionId:  describe result for acl check
2025-10-01T14:15:12.541554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:12.541560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:12.541562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:12.541568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256708050720561:4032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:12.541995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256708050720561:4032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:12.544765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256708050720561:4032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:12.547264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256708050720561:4032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:12.547276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256708050720561:4032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:12.547278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256708050720561:4032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:12.547285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:12.547440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:12.549454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:12.549622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:12.549632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:12.549644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:12.549682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:12.549712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256705673801360:8018]
2025-10-01T14:15:12.550082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:12.550297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:12.550327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:12.550553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:12.550595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.550596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.550597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.550597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.550598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.550599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.550600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.550600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.550602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.550602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.550603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.550604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.550607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.550613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.550616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.550618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.550620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.550622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.550624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.550626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.550627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.550630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.550632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.550634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.550636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.550638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.550643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.550648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.550652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.550655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.550657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.550660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.550662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.550664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.550667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.550669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.550672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.550674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.550677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.550679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.550681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.550684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.550687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.550689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.550691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.550694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.550698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.550700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.550703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.550705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.550707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.550710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.550712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.550714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.550732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:12.554519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:12.555454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:12.555467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:12.555469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:12.555471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:12.555477Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2464 [2:7556256705673801360:8018]
2025-10-01T14:15:12.555489Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:12.555501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:12.555503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.555504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.555505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.555519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:12.555525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:12.555531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:12.555572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.555578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.555580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.555582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:12.555584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:12.555646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:12.555653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.555663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.555673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.555687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:12.555708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050720347:2446], now have 1 active actors on pipe
2025-10-01T14:15:12.555715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050720760:4032], now have 1 active actors on pipe
2025-10-01T14:15:12.555720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.555722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.555723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.555734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:12.555744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:12.555746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:12.555751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:12.555753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:12.555758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:12.555761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:12.555751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2464
2025-10-01T14:15:12.555787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.555792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:12.555793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:12.555848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2464
2025-10-01T14:15:12.555929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.555940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.555962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:12.555968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.555975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.555976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:12.555984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.555992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:12.556004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.556159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.556168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.556181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.556251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2465 partition: 0 MaxSeqNo: 45 sessionId: src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0
2025-10-01T14:15:12.556582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926364c5-3f3a5dd6-69602a-81c6940c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:12.559296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Write session: try to update token
2025-10-01T14:15:12.559311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:12.566324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:12.566342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.566351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.566416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:12.566429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:12.566824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:12.567068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:12.567274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:12.567453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:12.567637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:12.567670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:12.573458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId: src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:12.575877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:12.576067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.576089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.576125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:12.576190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:12.583889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:12.583911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.583914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:12.583915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:12.583925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.583928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.583932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256705673801354:8018]
2025-10-01T14:15:12.583978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:12.583978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:12.583984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:12.583985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.583988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:12.583989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:12.584123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:12.631323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256708050720777:5192]
2025-10-01T14:15:12.631531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2464, pipe: [1:7556256708050720777:5192]
2025-10-01T14:15:12.717648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:12.725741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.725772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.725970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.726035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.726102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.726175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.726223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.726234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.726305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.726387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.726449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.726522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.726578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.726586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.726664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.726736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.726807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.726884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.726934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.726944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.727031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.727109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.727180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.727256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.727303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.727311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.727387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.727457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.727529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.727603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.727653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.727661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.727739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.727811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.727959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.728107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.728165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.728172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.728247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.728342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.728418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.728493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.728556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.728566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.728633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.728697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.728766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.728835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.728879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.728886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.728956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.729021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.729095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.729162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.729207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.729214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.729280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:12.729348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:12.729419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:12.729477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:12.729546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:12.729553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:12.729619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050720777:5192], now have 1 active actors on pipe
2025-10-01T14:15:12.729838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:12.729859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256708050720777:5192]
2025-10-01T14:15:12.729879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:12.729889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:12.729910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2465 reason: error at write: Disconnected sessionId: src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0
2025-10-01T14:15:12.730114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2465 sessionId: src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0 is DEAD
2025-10-01T14:15:12.730259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:12.730271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Write session will restart in 0.007406s
2025-10-01T14:15:12.730296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Write session: Do CDS request
2025-10-01T14:15:12.730303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:12.730610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:12.738768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.738873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:12.738889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2466
2025-10-01T14:15:12.738987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.739016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:12.739026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:12.739029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:12.739414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2466 sessionId:  describe result for acl check
2025-10-01T14:15:12.739454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:12.739460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:12.739462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:12.739468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256708050720978:4016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:12.740038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256708050720978:4016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:12.743058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256708050720978:4016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:12.745438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256708050720978:4016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:12.745452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256708050720978:4016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:12.745455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256708050720978:4016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:12.745462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:12.745724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:12.748024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:12.748207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:12.748220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:12.748231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:12.748288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:12.748323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256705673801673:8010]
2025-10-01T14:15:12.748850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:12.749121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:12.749164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:12.749440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:12.749497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.749502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.749503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.749504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.749505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.749506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.749507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.749508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.749509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.749510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.749511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.749512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.749513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.749514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.749519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.749529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.749533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.749537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.749540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.749544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.749548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.749551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.749555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.749560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.749564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.749572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.749577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.749583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.749590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.749602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.749612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.749621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.749630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.749639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.749647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.749655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.749662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.749666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.749673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.749677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.749685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.749694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.749701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.749705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.749713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.749717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.749724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.749729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.749735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.749739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.749746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.749750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.749757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.749761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.749767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.749772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.749809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:12.753185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:12.753971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:12.753990Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:12.753992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:12.753996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:12.754002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2465 [2:7556256705673801673:8010]
2025-10-01T14:15:12.754016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:12.754034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:12.754037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.754040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.754042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.754057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:12.754069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:12.754074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:12.754126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.754133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.754135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.754138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:12.754140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:12.754200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:12.754207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.754219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.754236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.754253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:12.754269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050721191:4016], now have 1 active actors on pipe
2025-10-01T14:15:12.754276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050720780:2446], now have 1 active actors on pipe
2025-10-01T14:15:12.754283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.754286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.754288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.754301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:12.754316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:12.754316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:12.754319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:12.754322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:12.754304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2465
2025-10-01T14:15:12.754334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:12.754340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:12.754364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2465
2025-10-01T14:15:12.754390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.754399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.754411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.754415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:12.754417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:12.754440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:12.754446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.754450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.754452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:12.754461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.754473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:12.754497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.754646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.754654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.754666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.754733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2466 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0
2025-10-01T14:15:12.755063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93039fa6-48c52fc6-b62b9a6b-4998b312_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:12.757576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Write session: try to update token
2025-10-01T14:15:12.757588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:12.770081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId: src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:12.772313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:12.773789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.773817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.773837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:12.773840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.773843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:12.773845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:12.773853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.773863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.773866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256705673801668:8010]
2025-10-01T14:15:12.773912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:12.773918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:12.773922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:12.773922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:12.773929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.773931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:12.774065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:12.829986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256708050721204:5192]
2025-10-01T14:15:12.830237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2465, pipe: [1:7556256708050721204:5192]
2025-10-01T14:15:12.911768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:12.912314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:12.912359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050721204:5192], now have 1 active actors on pipe
2025-10-01T14:15:12.912460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:12.912512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256708050721204:5192]
2025-10-01T14:15:12.912548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:12.912564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:12.912573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:12.912644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2466 reason: error at write: Disconnected sessionId: src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0
2025-10-01T14:15:12.912820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2466 sessionId: src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0 is DEAD
2025-10-01T14:15:12.912956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:12.912962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Write session will restart in 0.008726s
2025-10-01T14:15:12.912981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Write session: Do CDS request
2025-10-01T14:15:12.912996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:12.922961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.923250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:12.923270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2467
2025-10-01T14:15:12.923371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:12.923402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:12.923411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:12.923414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:12.923917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2467 sessionId:  describe result for acl check
2025-10-01T14:15:12.923959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:12.923966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:12.923968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:12.923973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256708050721258:4017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:12.924463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256708050721258:4017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:12.926649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256708050721258:4017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:12.929191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256708050721258:4017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:12.929206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256708050721258:4017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:12.929209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256708050721258:4017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:12.929217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:12.937960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:12.940369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:12.940582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:12.940592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:12.940603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:12.940652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:12.940692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256705673801977:8004]
2025-10-01T14:15:12.941295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:12.941571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:12.941606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:12.941926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:12.941978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.941983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.941985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.941986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.941987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.941988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.941989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.941990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.941992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.941993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.941995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.941996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.941997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.941998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.942003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.942013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.942017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.942022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.942026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.942030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.942034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.942038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.942042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.942046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.942050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.942054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.942058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.942062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.942070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.942078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:12.942084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.942089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:12.942094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.942100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:12.942104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.942109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:12.942114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.942119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:12.942124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.942130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:12.942135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.942140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:12.942145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.942151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:12.942155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.942160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:12.942165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.942170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.942179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.942185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.942189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.942194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.942203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.942208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:12.942213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.942222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:12.942262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:12.945757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:12.946430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:12.946444Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:12.946447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:12.946450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:12.946458Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2466 [2:7556256705673801977:8004]
2025-10-01T14:15:12.946474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:12.946491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:12.946493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.946497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.946499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.946515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:12.946526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:12.946532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:12.946588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.946596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.946598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.946601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:12.946604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:12.946673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:12.946680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.946691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:12.946706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:12.946724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:12.946745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050721445:4017], now have 1 active actors on pipe
2025-10-01T14:15:12.946753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256708050721207:2446], now have 1 active actors on pipe
2025-10-01T14:15:12.946761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.946769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.946771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.946784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:12.946799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:12.946800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:12.946808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:12.946810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:12.946813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:12.946816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:12.946841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.946848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:12.946853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:12.946829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2466
2025-10-01T14:15:12.946834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2466
2025-10-01T14:15:12.946871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.946881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.946913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:12.946924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:12.946929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:12.946935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:12.946944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:12.946957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:12.946979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.947104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:12.947113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:12.947127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:12.947191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2467 partition: 0 MaxSeqNo: 45 sessionId: src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0
2025-10-01T14:15:12.947526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9371ed-c5e11883-65fb5f6f-12bdc74b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:12.950227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Write session: try to update token
2025-10-01T14:15:12.950245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:12.964199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId: src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:12.966468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:12.966486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:12.966488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:12.966491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:12.966500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.966505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.966509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256705673801972:8004]
2025-10-01T14:15:12.966557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:12.966557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:12.966563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:12.966567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:12.966570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:12.966573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:12.966702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:12.966717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:13.012772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256712345688929:5192]
2025-10-01T14:15:13.012955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2466, pipe: [1:7556256712345688929:5192]
2025-10-01T14:15:13.103003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:13.103606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.103618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.103650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345688929:5192], now have 1 active actors on pipe
2025-10-01T14:15:13.103805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:13.103869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256712345688929:5192]
2025-10-01T14:15:13.103870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:13.103899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:13.103935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2467 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0
2025-10-01T14:15:13.104130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2467 sessionId: src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0 is DEAD
2025-10-01T14:15:13.104288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:13.104298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Write session will restart in 0.006699s
2025-10-01T14:15:13.104325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Write session: Do CDS request
2025-10-01T14:15:13.104331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:13.111843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.111943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:13.111958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2468
2025-10-01T14:15:13.112045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.112077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:13.112087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:13.112091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:13.112451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2468 sessionId:  describe result for acl check
2025-10-01T14:15:13.112479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:13.112485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:13.112487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:13.112491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256712345689075:3968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:13.113005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256712345689075:3968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:13.115048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256712345689075:3968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:13.118332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256712345689075:3968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:13.118348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256712345689075:3968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:13.118351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256712345689075:3968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:13.118358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:13.120964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:13.123330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:13.123587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:13.123597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:13.123610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:13.123657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:13.123693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256709968769583:8005]
2025-10-01T14:15:13.124153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:13.124492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:13.124558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:13.124885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:13.124944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.124951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.124952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.124953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.124954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.124956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.124957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.124958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.124960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.124961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.124962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.124963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.124964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.124966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.124971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.124981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.124985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.124989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.124992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.124996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.124999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.125003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.125006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.125010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.125014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.125018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.125022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.125025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.125032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.125039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.125045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.125051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.125055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.125060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.125065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.125075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.125080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.125085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.125094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.125099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.125103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.125113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.125117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.125122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.125139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.125148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.125153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.125162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.125167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.125180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.125184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.125190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.125200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.125205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.125214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.125219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.125260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:13.128788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:13.129410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:13.129423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:13.129426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:13.129430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:13.129436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2467 [2:7556256709968769583:8005]
2025-10-01T14:15:13.129451Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:13.129471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:13.129477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.129480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.129483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.129498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:13.129506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:13.129514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:13.129566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.129574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.129576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.129579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:13.129581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:13.129645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:13.129654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.129665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.129677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.129698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:13.129719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345689335:3968], now have 1 active actors on pipe
2025-10-01T14:15:13.129727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345688969:2446], now have 1 active actors on pipe
2025-10-01T14:15:13.129734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.129740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.129742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.129753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:13.129769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:13.129771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:13.129772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:13.129774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:13.129785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:13.129788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:13.129765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2467
2025-10-01T14:15:13.129765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2467
2025-10-01T14:15:13.129816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.129826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:13.129831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:13.129842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.129845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.129894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:13.129905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.129909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.129915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:13.129922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.129934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:13.129954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.130084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.130091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.130103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.130173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2468 partition: 0 MaxSeqNo: 45 sessionId: src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0
2025-10-01T14:15:13.130538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1645d-cdb214a4-f512a8ff-b59f135b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:13.133538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Write session: try to update token
2025-10-01T14:15:13.133557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:13.151211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:13.151235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.151237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:13.151239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:13.151249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.151255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.151259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256709968769578:8005]
2025-10-01T14:15:13.151314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:13.151315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:13.151321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.151322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:13.151324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:13.151326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:13.151472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:13.149424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId: src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:13.151676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:13.207184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256712345689391:5192]
2025-10-01T14:15:13.207487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2467, pipe: [1:7556256712345689391:5192]
2025-10-01T14:15:13.295086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:13.295584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.295598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.295632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345689391:5192], now have 1 active actors on pipe
2025-10-01T14:15:13.295846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256712345689391:5192]
2025-10-01T14:15:13.295878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:13.295880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:13.295892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:13.295933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2468 reason: error at write: Disconnected sessionId: src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0
2025-10-01T14:15:13.296103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2468 sessionId: src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0 is DEAD
2025-10-01T14:15:13.296326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:13.296337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Write session will restart in 0.007971s
2025-10-01T14:15:13.296362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Write session: Do CDS request
2025-10-01T14:15:13.296371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:13.297232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:13.305904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.305987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:13.306004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2469
2025-10-01T14:15:13.306147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.306190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:13.306195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:13.306199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:13.306569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2469 sessionId:  describe result for acl check
2025-10-01T14:15:13.306604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:13.306611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:13.306613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:13.306629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256712345689533:3947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:13.307128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256712345689533:3947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:13.309078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256712345689533:3947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:13.312994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256712345689533:3947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:13.313011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256712345689533:3947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:13.313014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256712345689533:3947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:13.313023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:13.320595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:13.323092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:13.323295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:13.323305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:13.323315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:13.323359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:13.323406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256709968769889:7995]
2025-10-01T14:15:13.323963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:13.324249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:13.324286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:13.324578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:13.324625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.324630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.324631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.324632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.324633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.324634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.324635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.324635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.324637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.324638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.324639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.324639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.324640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.324642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.324646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.324655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.324659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.324662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.324665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.324668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.324671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.324674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.324677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.324680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.324684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.324687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.324690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.324693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.324699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.324705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.324711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.324715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.324719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.324723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.324726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.324731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.324735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.324739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.324743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.324747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.324751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.324755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.324759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.324763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.324767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.324771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.324775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.324779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.324784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.324788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.324791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.324795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.324799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.324803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.324806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.324810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.324843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:13.328239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:13.328873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:13.328887Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:13.328889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:13.328892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:13.328898Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2468 [2:7556256709968769889:7995]
2025-10-01T14:15:13.328913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:13.328933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:13.328940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.328943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.328945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.328959Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:13.328968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:13.328974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:13.329025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.329031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.329033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.329036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:13.329038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:13.329087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:13.329092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.329102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.329115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.329134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:13.329151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345689606:3947], now have 1 active actors on pipe
2025-10-01T14:15:13.329157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345689394:2446], now have 1 active actors on pipe
2025-10-01T14:15:13.329162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.329164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.329165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.329173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:13.329181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:13.329183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:13.329184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:13.329189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:13.329201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:13.329208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:13.329227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.329234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:13.329236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:13.329213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2468
2025-10-01T14:15:13.329217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2468
2025-10-01T14:15:13.329261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.329270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.329293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|905e262b-e41ae8d9-83bd8785-74b73580_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:13.329301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.329304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.329306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:13.329312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.329318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:13.329329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.329434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.329441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.329452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.329532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2469 partition: 0 MaxSeqNo: 45 sessionId: src_id|905e262b-e41ae8d9-83bd8785-74b73580_0
2025-10-01T14:15:13.329844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42966c58-c29ec960-cd9d21f7-e74e0e37_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|905e262b-e41ae8d9-83bd8785-74b73580_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:13.332559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Write session: try to update token
2025-10-01T14:15:13.332576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:13.347627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId: src_id|905e262b-e41ae8d9-83bd8785-74b73580_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:13.349432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:13.349450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.350061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:13.349453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:13.349454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:13.349464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.349472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.349476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256709968769884:7995]
2025-10-01T14:15:13.349525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:13.349531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.349531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:13.349533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:13.349536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:13.349540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:13.349660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:13.396274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256712345689820:5192]
2025-10-01T14:15:13.396575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2468, pipe: [1:7556256712345689820:5192]
2025-10-01T14:15:13.487823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:13.488714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.488730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.488763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345689820:5192], now have 1 active actors on pipe
2025-10-01T14:15:13.488934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:13.488950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:13.489003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2469 reason: error at write: Disconnected sessionId: src_id|905e262b-e41ae8d9-83bd8785-74b73580_0
2025-10-01T14:15:13.489152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256712345689820:5192]
2025-10-01T14:15:13.489171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2469 sessionId: src_id|905e262b-e41ae8d9-83bd8785-74b73580_0 is DEAD
2025-10-01T14:15:13.489179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:13.489317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:13.489326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Write session will restart in 0.009177s
2025-10-01T14:15:13.489349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Write session: Do CDS request
2025-10-01T14:15:13.489358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:13.489309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:13.499889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.500042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:13.500059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2470
2025-10-01T14:15:13.500163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.500199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:13.500204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:13.500207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:13.500567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2470 sessionId:  describe result for acl check
2025-10-01T14:15:13.500593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:13.500597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:13.500598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:13.500603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256712345690011:3913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:13.501099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256712345690011:3913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:13.503414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256712345690011:3913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:13.506204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256712345690011:3913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:13.506222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256712345690011:3913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:13.506226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256712345690011:3913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:13.506239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:13.508863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:13.511427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:13.511633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:13.511637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:13.511954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:13.512025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:13.512067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256709968770228:7974]
2025-10-01T14:15:13.512581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:13.512839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:13.512893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:13.513177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:13.513237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.513243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.513243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.513244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.513245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.513245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.513246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.513247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.513248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.513248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.513249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.513250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.513251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.513251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.513255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.513261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.513263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.513265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.513267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.513270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.513272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.513274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.513276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.513278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.513280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.513282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.513284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.513285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.513290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.513295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.513298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.513302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.513304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.513307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.513309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.513312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.513315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.513318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.513320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.513323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.513326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.513329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.513331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.513334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.513337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.513340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.513343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.513345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.513348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.513350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.513352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.513355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.513358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.513361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.513364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.513366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.513388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:13.516684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:13.517290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:13.517300Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:13.517302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:13.517305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:13.517311Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2469 [2:7556256709968770228:7974]
2025-10-01T14:15:13.517325Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:13.517340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:13.517346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.517349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.517350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.517360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:13.517367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:13.517372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:13.517410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.517415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.517417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.517419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:13.517421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:13.517618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2469
2025-10-01T14:15:13.517622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2469
2025-10-01T14:15:13.517791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:13.517802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.517813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.517828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.517848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:13.517869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690203:3913], now have 1 active actors on pipe
2025-10-01T14:15:13.517876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345689827:2446], now have 1 active actors on pipe
2025-10-01T14:15:13.517895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.517904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.517923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.517929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.517931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.517946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:13.517962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:13.517963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:13.517970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:13.517971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:13.517976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:13.517979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:13.517994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:13.518005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.518009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.518011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:13.518019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.518033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:13.518064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.518072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:13.518077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:13.518086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.518230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.518238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.518252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.518334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2470 partition: 0 MaxSeqNo: 45 sessionId: src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0
2025-10-01T14:15:13.518676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905e262b-e41ae8d9-83bd8785-74b73580_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:13.521608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Write session: try to update token
2025-10-01T14:15:13.521628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:13.528947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:13.528966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.528976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.529016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:13.529022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:13.529187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:13.529322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.529454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.529588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.529814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:13.529857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:13.539502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId: src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:13.542121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:13.542329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.542350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.542403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:13.542502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:13.547467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:13.547484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.547486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:13.547487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:13.547496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.547499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.547502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256709968770218:7974]
2025-10-01T14:15:13.547538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:13.547541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:13.547544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.547545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:13.547545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:13.547548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:13.547672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:13.589297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256712345690257:5192]
2025-10-01T14:15:13.589572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2469, pipe: [1:7556256712345690257:5192]
2025-10-01T14:15:13.687698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:13.695269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.695295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.695437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.695493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.695554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.695608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.695652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.695660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.695722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.695776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.695831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.695892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.695933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.695939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.695992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.696041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.696095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.696154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.696194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.696200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.696254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.696306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.696356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.696408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.696448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.696454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.696512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.696577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.696633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.696689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.696729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.696734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.696791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.696842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.696893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.696947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.696990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.696994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.697050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.697102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.697157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.697221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.697271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.697276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.697339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.697396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.697448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.697500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.697541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.697546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.697603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.697654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.697709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.697763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.697801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.697806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.697867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:13.697921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:13.697972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:13.698030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:13.698069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:13.698074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:13.698113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690257:5192], now have 1 active actors on pipe
2025-10-01T14:15:13.698335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:13.698349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:13.698351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:13.698385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2470 reason: error at write: Disconnected sessionId: src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0
2025-10-01T14:15:13.698410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256712345690257:5192]
2025-10-01T14:15:13.698530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2470 sessionId: src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0 is DEAD
2025-10-01T14:15:13.698653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:13.698662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Write session will restart in 0.008383s
2025-10-01T14:15:13.698679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Write session: Do CDS request
2025-10-01T14:15:13.698684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:13.699095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:13.703779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:13.704812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:13.704948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:13.704954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:13.704962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:13.704992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:13.705019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256709968770302:7968]
2025-10-01T14:15:13.705377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:13.705570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:13.705595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:13.705774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:13.705806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.705810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.705810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.705811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.705812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.705812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.705813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.705814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.705814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.705815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.705816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.705817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.705817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.705818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.705821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.705827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.705829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.705831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.705833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.705837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.705839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.705841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.705843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.705845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.705847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.705849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.705851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.705853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.705857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.705861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.705865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.705868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.705870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.705873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.705875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.705878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.705881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.705884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.705886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.705889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.705892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.705894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.705896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.705899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.705901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.705904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.705906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.705909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.705911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.705913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.705916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.705918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.705921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.705923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.705925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.705927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.705947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:13.707806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.707842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:13.707857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2471
2025-10-01T14:15:13.707984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.708027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:13.708037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:13.708043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:13.708389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2471 sessionId:  describe result for acl check
2025-10-01T14:15:13.708420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:13.708425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:13.708427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:13.708432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256712345690288:3911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:13.708912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256712345690288:3911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:13.709267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:13.709886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:13.709900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:13.709903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:13.709907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:13.709913Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2470 [2:7556256709968770302:7968]
2025-10-01T14:15:13.709927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:13.709946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:13.709955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.709958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.709960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.709974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:13.709979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:13.709985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:13.710031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.710038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.710041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.710044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:13.710047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:13.710105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:13.710112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.710121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.710130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.710139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:13.710154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690264:2446], now have 1 active actors on pipe
2025-10-01T14:15:13.710159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.710160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.710161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.710170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:13.710179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:13.710181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:13.710189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:13.710191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:13.710196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:13.710197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:13.710178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2470
2025-10-01T14:15:13.710210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.710215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:13.710217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:13.711131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256712345690288:3911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:13.716000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256712345690288:3911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:13.716012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256712345690288:3911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:13.716015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256712345690288:3911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:13.716024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:13.716250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690327:3911], now have 1 active actors on pipe
2025-10-01T14:15:13.716294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2470
2025-10-01T14:15:13.716361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.716371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.716391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|308247d-d22dbd17-1d4c8f65-2257f998_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:13.716406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.716412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.716414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:13.716423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.716438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:13.716452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.716590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.716599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.716609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.716674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2471 partition: 0 MaxSeqNo: 45 sessionId: src_id|308247d-d22dbd17-1d4c8f65-2257f998_0
2025-10-01T14:15:13.717006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915d03ae-af63e2d4-c863c47-8d75e5f7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|308247d-d22dbd17-1d4c8f65-2257f998_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:13.720009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:13.720024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.720034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.720072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:13.720074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:13.720205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Write session: try to update token
2025-10-01T14:15:13.720223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:13.720238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:13.720379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.720513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.720661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.720882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:13.720921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:13.735374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId: src_id|308247d-d22dbd17-1d4c8f65-2257f998_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:13.737657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:13.738478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.738504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.738526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:13.738534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.738536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:13.738538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:13.738545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.738552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.738555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256709968770297:7968]
2025-10-01T14:15:13.738585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:13.738596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:13.738599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:13.738601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:13.738605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.738609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:13.738729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:13.798703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256712345690331:5192]
2025-10-01T14:15:13.798971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2470, pipe: [1:7556256712345690331:5192]
2025-10-01T14:15:13.882227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:13.882596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:13.882631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690331:5192], now have 1 active actors on pipe
2025-10-01T14:15:13.882729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:13.882777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:13.882837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256712345690331:5192]
2025-10-01T14:15:13.889593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:13.891026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:13.891166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:13.891174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:13.891182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:13.891222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:13.891251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256709968770362:7964]
2025-10-01T14:15:13.891658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:13.891803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:13.891818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:13.891854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2471 reason: error at write: Disconnected sessionId: src_id|308247d-d22dbd17-1d4c8f65-2257f998_0
2025-10-01T14:15:13.891978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2471 sessionId: src_id|308247d-d22dbd17-1d4c8f65-2257f998_0 is DEAD
2025-10-01T14:15:13.892095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:13.892103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Write session will restart in 0.007120s
2025-10-01T14:15:13.892126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Write session: Do CDS request
2025-10-01T14:15:13.892131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:13.895319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:13.895404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:13.895746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:13.895796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.895802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.895803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.895804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.895805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.895807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.895808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.895811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.895812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.895814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.895815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.895816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.895817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.895818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.895824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.895834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.895838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.895842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.895846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.895850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.895854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.895857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.895861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.895865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.895873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.895876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.895880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.895887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.895893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.895900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:13.895907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.895912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:13.895916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.895920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:13.895924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.895929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:13.895940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.895950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:13.895954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.895964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:13.895970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.895975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:13.895982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.895987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:13.895994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.895999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:13.896003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.896010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.896015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.896023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.896027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.896035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.896039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.896048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:13.896052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.896057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:13.896106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:13.899806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:13.900133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.900203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:13.900223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2472
2025-10-01T14:15:13.900355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:13.900386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:13.900396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:13.900399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:13.900533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:13.900561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:13.900565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:13.900568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:13.900576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2471 [2:7556256709968770362:7964]
2025-10-01T14:15:13.900592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:13.900612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:13.900619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.900623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.900626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.900645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:13.900656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:13.900662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:13.900720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.900726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.900728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.900731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:13.900734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:13.900796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:13.900803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.900815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:13.900828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:13.900840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:13.900825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2472 sessionId:  describe result for acl check
2025-10-01T14:15:13.900857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690333:2446], now have 1 active actors on pipe
2025-10-01T14:15:13.900857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:13.900867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.900868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.900862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:13.900871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.900864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:13.900883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:13.900893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:13.900869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256712345690358:3899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:13.900896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:13.900898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:13.900898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:13.900907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:13.900907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2471
2025-10-01T14:15:13.900909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:13.900936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.900947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:13.900952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:13.901385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256712345690358:3899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:13.904185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256712345690358:3899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:13.910133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256712345690358:3899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:13.910157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256712345690358:3899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:13.910161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256712345690358:3899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:13.910171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:13.910467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690396:3899], now have 1 active actors on pipe
2025-10-01T14:15:13.910521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2471
2025-10-01T14:15:13.911562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.911583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.911602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:13.911608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.911615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.911654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:13.911658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54970036-ff71ed79-a7386914-280eeba3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:13.911670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:13.911675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:13.911677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:13.911688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:13.911709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:13.911726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:13.911907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:13.912056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.912200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.912339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:13.912529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:13.912583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.912606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:13.912791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:13.912799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:13.912814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:13.912919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2472 partition: 0 MaxSeqNo: 45 sessionId: src_id|54970036-ff71ed79-a7386914-280eeba3_0
2025-10-01T14:15:13.913267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308247d-d22dbd17-1d4c8f65-2257f998_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54970036-ff71ed79-a7386914-280eeba3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:13.916054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Write session: try to update token
2025-10-01T14:15:13.916072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:13.930437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:13.930459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:13.930462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:13.930464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:13.930474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.930478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.930482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256709968770357:7964]
2025-10-01T14:15:13.930535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:13.930537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:13.930543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:13.930547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:13.930548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:13.930550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:13.930665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId: src_id|54970036-ff71ed79-a7386914-280eeba3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:13.930686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:13.933287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:13.983031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256712345690400:5192]
2025-10-01T14:15:13.983290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2471, pipe: [1:7556256712345690400:5192]
2025-10-01T14:15:14.077416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:14.077723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.077739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.077762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256712345690400:5192], now have 1 active actors on pipe
2025-10-01T14:15:14.077990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:14.077995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:14.078014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:14.078076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2472 reason: error at write: Disconnected sessionId: src_id|54970036-ff71ed79-a7386914-280eeba3_0
2025-10-01T14:15:14.078291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2472 sessionId: src_id|54970036-ff71ed79-a7386914-280eeba3_0 is DEAD
2025-10-01T14:15:14.078492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:14.078558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256712345690400:5192]
2025-10-01T14:15:14.082481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:14.082491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Write session will restart in 0.008376s
2025-10-01T14:15:14.082516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Write session: Do CDS request
2025-10-01T14:15:14.082522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:14.084979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:14.086230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:14.086429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:14.086440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:14.086455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:14.086506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:14.086549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256714263737717:7953]
2025-10-01T14:15:14.087455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:14.087678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:14.087709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:14.088037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:14.088078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.088082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.088083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.088084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.088085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.088085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.088086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.088087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.088087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.088089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.088090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.088090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.088091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.088092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.088095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.088101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.088103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.088105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.088107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.088109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.088111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.088113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.088115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.088119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.088121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.088123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.088125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.088126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.088131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.088136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.088140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.088143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.088145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.088148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.088150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.088153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.088155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.088158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.088172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.088178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.088181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.088183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.088186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.088190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.088192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.088196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.088199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.088201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.088203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.088205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.088208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.088210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.088213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.088216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.088218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.088239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:14.091447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:14.091858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.091959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:14.091973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2473
2025-10-01T14:15:14.092072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:14.092083Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:14.092084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:14.092086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:14.092091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2472 [2:7556256714263737717:7953]
2025-10-01T14:15:14.092100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:14.092096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.092112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:14.092119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.092122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.092124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.092129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:14.092135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:14.092138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:14.092141Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:14.092149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:14.092153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:14.092186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.092192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.092193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.092195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:14.092197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:14.092242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:14.092247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.092253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.092259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.092267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:14.092282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657712:2446], now have 1 active actors on pipe
2025-10-01T14:15:14.092290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.092292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.092293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.092303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:14.092296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2472
2025-10-01T14:15:14.092316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:14.092320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:14.092323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:14.092325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:14.092327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:14.092329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:14.092348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.092353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:14.092369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:14.092449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2473 sessionId:  describe result for acl check
2025-10-01T14:15:14.092482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:14.092488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:14.092489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:14.092493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256716640657739:3893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:14.092928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256716640657739:3893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:14.094735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256716640657739:3893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:14.098362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256716640657739:3893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:14.098392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256716640657739:3893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:14.098395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256716640657739:3893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:14.098402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:14.098579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657777:3893], now have 1 active actors on pipe
2025-10-01T14:15:14.098626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2472
2025-10-01T14:15:14.098684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.098696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.098728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9961189f-6e7fae9-806975c3-b42f4777_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:14.098742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.098752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.098754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:14.098763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.098775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:14.098794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.098909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.098916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.098929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.099031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2473 partition: 0 MaxSeqNo: 45 sessionId: src_id|9961189f-6e7fae9-806975c3-b42f4777_0
2025-10-01T14:15:14.099360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54970036-ff71ed79-a7386914-280eeba3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9961189f-6e7fae9-806975c3-b42f4777_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:14.102445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Write session: try to update token
2025-10-01T14:15:14.102458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:14.102788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:14.102802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.102810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.102846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:14.102847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:14.103023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:14.103164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.103297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.103427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.103618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:14.103654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:14.116190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId: src_id|9961189f-6e7fae9-806975c3-b42f4777_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:14.118446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:14.118641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.118667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.118705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:14.118793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:14.121682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:14.121704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.121707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:14.121709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:14.121719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.121726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.121730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256714263737712:7953]
2025-10-01T14:15:14.121773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:14.121778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:14.121785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:14.121787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.121789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:14.121790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:14.121970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:14.178608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256716640657802:5192]
2025-10-01T14:15:14.182153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2472, pipe: [1:7556256716640657802:5192]
2025-10-01T14:15:14.260255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:14.267899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.267930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.268095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.268152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.268222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.268287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.268335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.268344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.268422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.268489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.268565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.268632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.268674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.268679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.268752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.268834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.268900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.268968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.269019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.269025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.269094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.269160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.269229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.269295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.269343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.269351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.269414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.269470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.269535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.269608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.269656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.269662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.269736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.269803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.269868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.269931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.269984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.269992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.270059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.270120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.270188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.270255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.270301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.270308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.270408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.270487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.270562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.270641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.270693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.270700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.270777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.270853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.270925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.271004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.271055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.271062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.271133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.271198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.271264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.271326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.271419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.271424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.271485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657802:5192], now have 1 active actors on pipe
2025-10-01T14:15:14.271741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:14.271760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:14.271789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2473 reason: error at write: Disconnected sessionId: src_id|9961189f-6e7fae9-806975c3-b42f4777_0
2025-10-01T14:15:14.271987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2473 sessionId: src_id|9961189f-6e7fae9-806975c3-b42f4777_0 is DEAD
2025-10-01T14:15:14.272094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:14.272113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Write session will restart in 0.009064s
2025-10-01T14:15:14.272139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Write session: Do CDS request
2025-10-01T14:15:14.272145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:14.272166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:14.272272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256716640657802:5192]
2025-10-01T14:15:14.272438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:14.278164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:14.279540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:14.279732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:14.279741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:14.279752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:14.279805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:14.279843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256714263737787:7943]
2025-10-01T14:15:14.280418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:14.280731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:14.280779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:14.281021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:14.281063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.281068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.281068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.281069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.281070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.281070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.281071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.281072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.281073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.281074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.281075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.281075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.281076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.281077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.281081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.281086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.281089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.281091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.281093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.281095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.281097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.281099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.281101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.281103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.281105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.281107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.281111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.281113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.281118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.281123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.281127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.281130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.281132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.281135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.281138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.281141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.281143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.281146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.281148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.281151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.281154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.281157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.281159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.281161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.281163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.281166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.281168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.281170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.281173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.281175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.281178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.281180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.281182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.281185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.281187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.281189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.281209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:14.281862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.281921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:14.281938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2474
2025-10-01T14:15:14.282022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.282045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:14.282052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:14.282055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:14.282432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2474 sessionId:  describe result for acl check
2025-10-01T14:15:14.282467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:14.282469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:14.282471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:14.282476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256716640657831:3867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:14.282980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256716640657831:3867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:14.284710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256716640657831:3867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:14.284750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:14.285361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:14.285375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:14.285377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:14.285380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:14.285386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2473 [2:7556256714263737787:7943]
2025-10-01T14:15:14.285401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:14.285414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:14.285416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.285418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.285420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.285432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:14.285439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:14.285444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:14.285480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.285485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.285486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.285488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:14.285490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:14.285537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:14.285544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.285552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.285557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.285566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:14.285578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.285580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.285581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.285587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:14.285596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:14.285599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:14.285601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:14.285601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:14.285609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:14.285610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:14.285622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657805:2446], now have 1 active actors on pipe
2025-10-01T14:15:14.285643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.285651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:14.285664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:14.285674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2473
2025-10-01T14:15:14.290092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256716640657831:3867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:14.290105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256716640657831:3867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:14.290108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256716640657831:3867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:14.290115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:14.290299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657868:3867], now have 1 active actors on pipe
2025-10-01T14:15:14.290329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2473
2025-10-01T14:15:14.290404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.290415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.290441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:14.290463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.290472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.290475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:14.290484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.290498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:14.290523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.290664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.290670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.290683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.290760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2474 partition: 0 MaxSeqNo: 45 sessionId: src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0
2025-10-01T14:15:14.291095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9961189f-6e7fae9-806975c3-b42f4777_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:14.293994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Write session: try to update token
2025-10-01T14:15:14.294012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:14.295831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:14.295846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.295854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.295897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:14.295904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:14.296070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:14.296209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.296337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.296468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.296664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:14.296699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:14.307505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId: src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:14.309935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:14.310107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.310128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.310158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:14.310213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:14.313468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:14.313485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.313487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:14.313489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:14.313499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.313503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.313506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256714263737782:7943]
2025-10-01T14:15:14.313547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:14.313554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:14.313557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.313560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:14.313561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:14.313565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:14.313678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:14.372660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256716640657872:5192]
2025-10-01T14:15:14.372923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2473, pipe: [1:7556256716640657872:5192]
2025-10-01T14:15:14.452518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:14.459546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.459574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.459726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.459783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.459845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.459902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.459950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.459959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.460023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.460082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.460142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.460206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.460257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.460264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.460327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.460383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.460446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.460514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.460569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.460579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.460649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.460715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.460788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.460857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.460902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.460909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.460971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.461024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.461083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.461144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.461184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.461191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.461259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.461315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.461369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.461422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.461467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.461474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.461532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.461581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.461636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.461698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.461744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.461752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.461822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.461881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.461944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.462017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.462064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.462068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.462130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.462223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.462285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.462337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.462413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.462419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.462474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.462531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.462587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.462678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.462722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.462729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.462774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657872:5192], now have 1 active actors on pipe
2025-10-01T14:15:14.462970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:14.462985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:14.463020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2474 reason: error at write: Disconnected sessionId: src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0
2025-10-01T14:15:14.463144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256716640657872:5192]
2025-10-01T14:15:14.463173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:14.463238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2474 sessionId: src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0 is DEAD
2025-10-01T14:15:14.463358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:14.463368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Write session will restart in 0.008520s
2025-10-01T14:15:14.463393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Write session: Do CDS request
2025-10-01T14:15:14.463399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:14.463734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:14.469192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:14.470438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:14.470609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:14.470617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:14.470627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:14.470671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:14.470707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256714263737861:7939]
2025-10-01T14:15:14.471293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:14.471540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:14.471581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:14.471866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:14.471936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.471942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.471943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.471944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.471945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.471946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.471947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.471948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.471953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.471954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.471955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.471955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.471956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.471957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.471961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.471971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.471974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.471978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.471981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.471985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.471988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.471992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.471996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.471999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.472003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.472006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.472009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.472012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.472019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.472026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.472032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.472037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.472043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.472048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.472051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.472056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.472060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.472065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.472068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.472079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.472084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.472094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.472097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.472104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.472107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.472115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.472118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.472122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.472127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.472134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.472138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.472142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.472147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.472154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.472158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.472161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.472193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:14.472865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.472952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:14.472968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2475
2025-10-01T14:15:14.473099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.473137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:14.473148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:14.473151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:14.473438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2475 sessionId:  describe result for acl check
2025-10-01T14:15:14.473466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:14.473470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:14.473472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:14.473476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256716640657902:3855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:14.473833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256716640657902:3855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:14.475539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:14.475967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256716640657902:3855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:14.476133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:14.476144Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:14.476146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:14.476148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:14.476154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2474 [2:7556256714263737861:7939]
2025-10-01T14:15:14.476163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:14.476174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:14.476179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.476182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.476183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.476193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:14.476197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:14.476201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:14.476234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.476239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.476241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.476243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:14.476244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:14.476296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:14.476303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.476313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.476325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.476336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:14.476352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657875:2446], now have 1 active actors on pipe
2025-10-01T14:15:14.476357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.476364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.476365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.476375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:14.476386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:14.476392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:14.476395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:14.476397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:14.476388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2474
2025-10-01T14:15:14.476397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:14.476398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:14.476415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.476417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:14.476419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:14.480757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256716640657902:3855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:14.480768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256716640657902:3855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:14.480770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256716640657902:3855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:14.480775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:14.480955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657940:3855], now have 1 active actors on pipe
2025-10-01T14:15:14.480987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2474
2025-10-01T14:15:14.481033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.481040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.481059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:14.481069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.481081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.481087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:14.481095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.481106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:14.481119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.481252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.481257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.481265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.481326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2475 partition: 0 MaxSeqNo: 45 sessionId: src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0
2025-10-01T14:15:14.481635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ff2fb5-b0cd93c6-cdcabaa8-da428827_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:14.484564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Write session: try to update token
2025-10-01T14:15:14.484577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:14.486650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:14.486670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.486678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.486720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:14.486729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:14.486882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:14.487019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.487156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.487291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:14.487487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:14.487520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:14.498001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId: src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:14.500655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:14.500945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.500968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.501005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:14.501087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:14.505985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:14.506006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.506007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:14.506010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:14.506019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.506023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.506026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256714263737856:7939]
2025-10-01T14:15:14.506049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:14.506057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:14.506060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:14.506068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:14.506074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.506077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:14.506218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:14.563110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256716640657946:5192]
2025-10-01T14:15:14.563388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2474, pipe: [1:7556256716640657946:5192]
2025-10-01T14:15:14.667365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:14.675632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.675660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.675820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.675875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.675930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.675981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.676205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.676214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.676274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.676328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.676381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.676437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.676477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.676488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.676564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.676622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.676679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.676739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.676780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.676787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.676847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.676902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.676958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.677020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.677060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.677067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.677124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.677181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.677239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.677295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.677341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.677348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.677410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.677462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.677520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.677576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.677616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.677623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.677684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.677737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.677795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.677852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.677895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.677902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.677974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.678036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.678109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.678183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.678233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.678241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.678307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.678362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.678442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.678501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.678543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.678550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.678612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:14.678669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:14.678733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:14.678794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:14.678836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:14.678843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:14.678905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657946:5192], now have 1 active actors on pipe
2025-10-01T14:15:14.679149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:14.679164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256716640657946:5192]
2025-10-01T14:15:14.679166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:14.679192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2475 reason: error at write: Disconnected sessionId: src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0
2025-10-01T14:15:14.679195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:14.679382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2475 sessionId: src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0 is DEAD
2025-10-01T14:15:14.679517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:14.679528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Write session will restart in 0.005033s
2025-10-01T14:15:14.679552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Write session: Do CDS request
2025-10-01T14:15:14.679558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:14.679878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:14.685390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:14.685772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:14.685862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.685895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:14.685910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2476
2025-10-01T14:15:14.685949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:14.685959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:14.685969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:14.686016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:14.686053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256714263737953:7927]
2025-10-01T14:15:14.686073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.686094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:14.686101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:14.686103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:14.686410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2476 sessionId:  describe result for acl check
2025-10-01T14:15:14.686435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:14.686437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:14.686439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:14.686443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256716640657978:3845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:14.686624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:14.686871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256716640657978:3845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:14.687002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:14.687042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:14.687307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:14.687361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.687367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.687368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.687368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.687369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.687371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.687371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.687372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.687373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.687374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.687376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.687377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.687378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.687379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.687383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.687391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.687394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.687397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.687402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.687405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.687408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.687411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.687414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.687418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.687421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.687424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.687427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.687430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.687437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.687446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.687456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.687465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.687472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.687477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.687480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.687485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.687488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.687493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.687501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.687506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.687510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.687518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.687522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.687530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.687538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.687545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.687549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.687558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.687565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.687572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.687580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.687588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.687591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.687595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.687598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.687603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.687638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:14.689203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256716640657978:3845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:14.691031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:14.691635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256716640657978:3845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:14.691647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256716640657978:3845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:14.691649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256716640657978:3845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:14.691655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:14.691684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:14.691701Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:14.691705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:14.691708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:14.691714Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2475 [2:7556256714263737953:7927]
2025-10-01T14:15:14.691728Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:14.691744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:14.691752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.691756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.691759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.691774Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:14.691783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:14.691789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:14.691844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.691851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.691853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.691856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:14.691860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:14.691921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:14.691929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.691941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.691957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.691977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:14.691974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2475
2025-10-01T14:15:14.691983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2475
2025-10-01T14:15:14.691997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640658016:3845], now have 1 active actors on pipe
2025-10-01T14:15:14.692004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640657954:2446], now have 1 active actors on pipe
2025-10-01T14:15:14.692011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.692013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.692016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.692025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:14.692029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:14.692031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:14.692032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:14.692041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:14.692053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:14.692060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:14.692082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.692090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.692131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.692145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:14.692148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:14.692163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:14.692174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.692180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.692187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:14.692195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.692204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:14.692238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.692359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.692368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.692381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.692457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2476 partition: 0 MaxSeqNo: 45 sessionId: src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0
2025-10-01T14:15:14.692789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13553da1-a36501b8-e19b2ae2-cf16fb9f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:14.695686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Write session: try to update token
2025-10-01T14:15:14.695703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:14.709241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId: src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:14.711386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:14.711725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.711751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.711773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:14.711775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.711777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:14.711779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:14.711785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.711788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.711792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256714263737948:7927]
2025-10-01T14:15:14.711826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:14.711838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:14.711841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:14.711842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:14.711848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.711850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:14.711995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:14.779169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256716640658024:5192]
2025-10-01T14:15:14.779407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2475, pipe: [1:7556256716640658024:5192]
2025-10-01T14:15:14.856154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:14.856563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:14.856618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640658024:5192], now have 1 active actors on pipe
2025-10-01T14:15:14.856693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:14.856771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:14.856806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:14.856810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:14.856828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256716640658024:5192]
2025-10-01T14:15:14.856886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2476 reason: error at write: Disconnected sessionId: src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0
2025-10-01T14:15:14.857031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2476 sessionId: src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0 is DEAD
2025-10-01T14:15:14.857161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:14.857173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Write session will restart in 0.005192s
2025-10-01T14:15:14.857197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Write session: Do CDS request
2025-10-01T14:15:14.857206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:14.863427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:14.863840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.863933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:14.863950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2477
2025-10-01T14:15:14.864056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:14.864086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:14.864105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:14.864112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:14.864505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2477 sessionId:  describe result for acl check
2025-10-01T14:15:14.864549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:14.864554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:14.864556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:14.864561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256716640658051:3829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:14.864681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:14.864848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:14.864860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:14.864871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:14.864919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:14.864960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256714263738017:7920]
2025-10-01T14:15:14.865004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256716640658051:3829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:14.865529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:14.865778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:14.865822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:14.866101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:14.866180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.866186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.866187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.866188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.866189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.866190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.866192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.866193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.866194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.866195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.866197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.866198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.866199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.866200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.866205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.866214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.866218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.866224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.866227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.866231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.866234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.866238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.866242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.866246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.866250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.866256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.866259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.866263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.866269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.866277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:14.866288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.866293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:14.866302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.866307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:14.866315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.866321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:14.866330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.866336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:14.866340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.866345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:14.866353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.866359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:14.866368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.866389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:14.866393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.866399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:14.866407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.866412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.866417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.866426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.866430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.866439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.866443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.866452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:14.866456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.866461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:14.866504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:14.866866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256716640658051:3829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:14.869675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256716640658051:3829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:14.869690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256716640658051:3829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:14.869694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256716640658051:3829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:14.869701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:14.869971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:14.870620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:14.870634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:14.870637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:14.870640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:14.870647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2476 [2:7556256714263738017:7920]
2025-10-01T14:15:14.870662Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:14.870678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:14.870685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.870689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.870691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.870707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:14.870716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:14.870722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:14.870772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.870779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.870781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.870784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:14.870787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:14.870847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:14.870854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.870864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:14.870874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:14.870894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:14.870915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640658026:2446], now have 1 active actors on pipe
2025-10-01T14:15:14.870922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640658090:3829], now have 1 active actors on pipe
2025-10-01T14:15:14.870909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2476
2025-10-01T14:15:14.870929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.870931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.870933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.870941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:14.870949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:14.870951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:14.870953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:14.870953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:14.870966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:14.870973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:14.870962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2476
2025-10-01T14:15:14.871013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.871020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.871033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.871044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:14.871061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:14.871075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:14.871085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:14.871090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:14.871092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:14.871101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:14.871109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:14.871133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.871334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.871348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.871370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:14.871445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2477 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0
2025-10-01T14:15:14.871779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b049ce-94bbe286-fc6b7b94-445fd253_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:14.874506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Write session: try to update token
2025-10-01T14:15:14.874525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:14.888362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId: src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:14.890882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:14.891446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:14.891472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:14.891493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:14.891496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:14.891499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:14.891501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:14.891509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.891517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.891522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256714263738012:7920]
2025-10-01T14:15:14.891565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:14.891582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:14.891586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:14.891588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:14.891595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:14.891598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:14.891741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:14.956837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256716640658098:5192]
2025-10-01T14:15:14.957112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2476, pipe: [1:7556256716640658098:5192]
2025-10-01T14:15:15.031339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:15.031776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:15.031848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256716640658098:5192], now have 1 active actors on pipe
2025-10-01T14:15:15.031979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:15.032072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256716640658098:5192]
2025-10-01T14:15:15.032108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:15.032209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:15.032218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:15.032289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2477 reason: error at write: Disconnected sessionId: src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0
2025-10-01T14:15:15.032448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2477 sessionId: src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0 is DEAD
2025-10-01T14:15:15.032656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:15.032667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Write session will restart in 0.009412s
2025-10-01T14:15:15.032687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Write session: Do CDS request
2025-10-01T14:15:15.032692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:15.039605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:15.040846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:15.040999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:15.041007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:15.041015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:15.041053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:15.041080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256718558705377:7916]
2025-10-01T14:15:15.041478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:15.041721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:15.041755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:15.042031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:15.042097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.042103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.042104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.042105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.042107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.042108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.042109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.042110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.042112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.042113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.042114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.042115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.042116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.042117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.042122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.042132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.042137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.042141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.042144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.042148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.042151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.042156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.042159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.042163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.042170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.042172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.042174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.042176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.042181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.042189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.042193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.042199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.042201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.042204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.042207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.042210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.042212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.042215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.042221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.042225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.042232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.042234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.042238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.042240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.042243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.042246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.042251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.042254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.042258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.042264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.042266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.042268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.042274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.042277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.042279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.042285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.042305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:15.042892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.042963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:15.042980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2478
2025-10-01T14:15:15.043094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.043121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:15.043130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:15.043134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:15.043505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2478 sessionId:  describe result for acl check
2025-10-01T14:15:15.043544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:15.043551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:15.043553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:15.043557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256720935625440:3814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:15.044055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256720935625440:3814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:15.045728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:15.046128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256720935625440:3814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:15.046359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:15.046387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:15.046390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:15.046393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:15.046400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2477 [2:7556256718558705377:7916]
2025-10-01T14:15:15.046414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:15.046430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:15.046434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.046436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.046437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.046449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:15.046453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:15.046457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:15.046499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.046505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.046506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.046509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:15.046513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:15.046570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:15.046577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.046588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.046602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.046620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:15.046640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625397:2446], now have 1 active actors on pipe
2025-10-01T14:15:15.046651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.046657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.046660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.046671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:15.046687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:15.046687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:15.046689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:15.046691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:15.046703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:15.046679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2477
2025-10-01T14:15:15.046705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:15.046739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.046748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:15.046759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:15.051244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256720935625440:3814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:15.051259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256720935625440:3814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:15.051263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256720935625440:3814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:15.051282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:15.051484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625479:3814], now have 1 active actors on pipe
2025-10-01T14:15:15.051523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2477
2025-10-01T14:15:15.051600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.051611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.051637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d356da91-a42cd09a-7308a69a-5773edaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:15.051651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.051660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.051668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:15.051683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.051701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:15.051721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.051871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.051879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.051893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.051965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2478 partition: 0 MaxSeqNo: 45 sessionId: src_id|d356da91-a42cd09a-7308a69a-5773edaa_0
2025-10-01T14:15:15.052302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac8aab-e037bc5-4df7da0b-8e7b5972_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d356da91-a42cd09a-7308a69a-5773edaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:15.055099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Write session: try to update token
2025-10-01T14:15:15.055115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:15.062131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:15.062150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.062160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.062202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:15.062206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:15.062360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:15.062511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.062646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.062772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.062951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:15.062984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:15.070703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId: src_id|d356da91-a42cd09a-7308a69a-5773edaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:15.073608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:15.073812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.073845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.075954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:15.075994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:15.075997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.076000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:15.076002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:15.076012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.076017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.076020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256718558705372:7916]
2025-10-01T14:15:15.076042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:15.076052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:15.076056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:15.076063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:15.076070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.076077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:15.076086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:15.076215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:15.132459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256720935625484:5192]
2025-10-01T14:15:15.132708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2477, pipe: [1:7556256720935625484:5192]
2025-10-01T14:15:15.214324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:15.221871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.221907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.222081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.222143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.222213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.222273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.222315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.222323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.222410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.222480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.222544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.222605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.222652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.222662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.222734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.222795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.222855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.222927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.222975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.222981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.223049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.223112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.223182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.223241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.223283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.223288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.223349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.223412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.223479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.223540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.223667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.223675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.223738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.223796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.223862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.223927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.223975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.223983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.224051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.224110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.224184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.224250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.224293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.224302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.224378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.224455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.224524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.224610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.224660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.224667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.224742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.224799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.224869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.224939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.224982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.224989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.225061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.225121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.225187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.225250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.225290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.225293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.225363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625484:5192], now have 1 active actors on pipe
2025-10-01T14:15:15.225562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:15.225607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256720935625484:5192]
2025-10-01T14:15:15.225609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:15.225611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:15.225635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2478 reason: error at write: Disconnected sessionId: src_id|d356da91-a42cd09a-7308a69a-5773edaa_0
2025-10-01T14:15:15.225803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2478 sessionId: src_id|d356da91-a42cd09a-7308a69a-5773edaa_0 is DEAD
2025-10-01T14:15:15.225949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:15.225958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Write session will restart in 0.009856s
2025-10-01T14:15:15.225977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Write session: Do CDS request
2025-10-01T14:15:15.225982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:15.226306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:15.232120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:15.233458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:15.233633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:15.233642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:15.233653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:15.233699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:15.233742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256718558705450:7909]
2025-10-01T14:15:15.234358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:15.234633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:15.234676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:15.234987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:15.235045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.235051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.235052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.235054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.235055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.235057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.235058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.235059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.235061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.235063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.235064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.235068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.235069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.235070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.235075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.235085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.235089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.235098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.235102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.235109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.235112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.235116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.235120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.235129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.235132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.235136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.235140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.235143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.235150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.235161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.235171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.235177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.235185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.235191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.235196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.235202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.235211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.235216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.235224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.235229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.235238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.235243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.235253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.235258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.235267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.235271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.235280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.235285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.235289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.235294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.235298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.235306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.235310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.235320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.235324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.235332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.235372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:15.236957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.237005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:15.237024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2479
2025-10-01T14:15:15.237156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.237186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:15.237199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:15.237203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:15.237652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2479 sessionId:  describe result for acl check
2025-10-01T14:15:15.237684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:15.237691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:15.237694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:15.237708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256720935625546:3786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:15.238109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256720935625546:3786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:15.239042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:15.239664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:15.239681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:15.239684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:15.239688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:15.239696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2478 [2:7556256718558705450:7909]
2025-10-01T14:15:15.239711Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:15.239731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:15.239739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.239743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.239746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.239762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:15.239772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:15.239778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:15.239835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.239842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.239843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.239846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:15.239847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:15.239901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:15.239909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.239917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.239923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.239932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:15.239946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625514:2446], now have 1 active actors on pipe
2025-10-01T14:15:15.239953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.239962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.239963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.239977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:15.239991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:15.239994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:15.240001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:15.240004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:15.240006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:15.240008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:15.240000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2478
2025-10-01T14:15:15.240034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.240047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:15.240053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:15.240325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256720935625546:3786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:15.246492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256720935625546:3786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:15.246514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256720935625546:3786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:15.246517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256720935625546:3786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:15.246527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:15.246790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625581:3786], now have 1 active actors on pipe
2025-10-01T14:15:15.246832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2478
2025-10-01T14:15:15.246883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.246898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.246927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:15.246944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.246949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.246957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:15.246970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.246989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:15.247011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.247201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.247209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.247222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.247270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2479 partition: 0 MaxSeqNo: 45 sessionId: src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0
2025-10-01T14:15:15.247603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d356da91-a42cd09a-7308a69a-5773edaa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:15.250473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Write session: try to update token
2025-10-01T14:15:15.250489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:15.250541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:15.250562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.250571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.250612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:15.250617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:15.250776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:15.250921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.251069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.251219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.251431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:15.251470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:15.266390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId: src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:15.269010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:15.270520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.270543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.270561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:15.270563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.270565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:15.270566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:15.270573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.270576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.270579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256718558705445:7909]
2025-10-01T14:15:15.270615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:15.270620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:15.270623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:15.270623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:15.270627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.270632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:15.270754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:15.325994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256720935625587:5192]
2025-10-01T14:15:15.326272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2478, pipe: [1:7556256720935625587:5192]
2025-10-01T14:15:15.407769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:15.408221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:15.408266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625587:5192], now have 1 active actors on pipe
2025-10-01T14:15:15.408360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:15.408475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:15.408482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:15.408497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256720935625587:5192]
2025-10-01T14:15:15.408525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:15.408564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2479 reason: error at write: Disconnected sessionId: src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0
2025-10-01T14:15:15.408700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2479 sessionId: src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0 is DEAD
2025-10-01T14:15:15.408840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:15.408850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Write session will restart in 0.007819s
2025-10-01T14:15:15.408885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Write session: Do CDS request
2025-10-01T14:15:15.408893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:15.414558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:15.416042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:15.416227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:15.416235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:15.416244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:15.416283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:15.416321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256718558705518:7906]
2025-10-01T14:15:15.416846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:15.417098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:15.417129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:15.417353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:15.417394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.417398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.417399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.417399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.417400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.417401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.417403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.417404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.417405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.417405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.417406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.417408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.417409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.417410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.417414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.417422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.417426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.417430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.417433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.417437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.417441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.417445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.417448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.417452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.417456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.417460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.417463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.417466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.417472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.417480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.417485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.417489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.417498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.417503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.417511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.417515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.417523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.417537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.417541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.417543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.417546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.417548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.417550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.417553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.417555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.417557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.417564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.417566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.417569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.417571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.417573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.417576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.417579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.417585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.417589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.417615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:15.417864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.417941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:15.417955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2480
2025-10-01T14:15:15.418073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.418104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:15.418107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:15.418110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:15.418530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2480 sessionId:  describe result for acl check
2025-10-01T14:15:15.418568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:15.418574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:15.418576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:15.418581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256720935625622:3765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:15.419150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256720935625622:3765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:15.420780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256720935625622:3765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:15.421393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:15.422008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:15.422024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:15.422027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:15.422029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:15.422034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2479 [2:7556256718558705518:7906]
2025-10-01T14:15:15.422047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:15.422060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:15.422066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.422069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.422070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.422089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:15.422103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:15.422113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:15.422152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.422157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.422159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.422161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:15.422163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:15.422231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:15.422240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.422252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.422261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.422277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:15.422293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625589:2446], now have 1 active actors on pipe
2025-10-01T14:15:15.422303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.422304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.422308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.422321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:15.422309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2479
2025-10-01T14:15:15.422330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:15.422332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:15.422333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:15.422338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:15.422351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:15.422357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:15.422410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.422419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:15.422445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:15.427037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256720935625622:3765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:15.427060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256720935625622:3765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:15.427064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256720935625622:3765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:15.427073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:15.427335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625661:3765], now have 1 active actors on pipe
2025-10-01T14:15:15.427353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2479
2025-10-01T14:15:15.427386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.427397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.427425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:15.427439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.427450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.427453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:15.427464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.427481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:15.427500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.427675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.427685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.427699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.427769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2480 partition: 0 MaxSeqNo: 45 sessionId: src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0
2025-10-01T14:15:15.428132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd42f5f-7d7b9b5d-9946c187-891923fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:15.430895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Write session: try to update token
2025-10-01T14:15:15.430912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:15.432446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:15.432466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.432474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.432506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:15.432514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:15.432682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:15.432818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.432950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.433081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.433265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:15.433302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:15.444943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId: src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:15.447549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:15.447751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.447775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.447808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:15.447869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:15.451063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:15.451086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.451089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:15.451093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:15.451103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.451106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.451111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256718558705513:7906]
2025-10-01T14:15:15.451150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:15.451152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:15.451157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.451158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:15.451162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:15.451165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:15.451277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:15.508755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256720935625664:5192]
2025-10-01T14:15:15.508982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2479, pipe: [1:7556256720935625664:5192]
2025-10-01T14:15:15.589582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:15.596869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.596897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.597028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.597076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.597128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.597190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.597232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.597238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.597293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.597344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.597395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.597457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.597495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.597503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.597562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.597615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.597678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.597738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.597778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.597783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.597849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.597910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.597969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.598027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.598067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.598072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.598128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.598185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.598245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.598298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.598337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.598343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.598419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.598472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.598525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.598580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.598618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.598623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.598681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.598730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.598784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.598838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.598876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.598881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.598959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.599020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.599081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.599142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.599188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.599198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.599273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.599328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.599380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.599431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.599476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.599483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.599541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.599592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.599645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.599701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.599746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.599752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.599804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625664:5192], now have 1 active actors on pipe
2025-10-01T14:15:15.600039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:15.600042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:15.600046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:15.600073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2480 reason: error at write: Disconnected sessionId: src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0
2025-10-01T14:15:15.600100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256720935625664:5192]
2025-10-01T14:15:15.600249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2480 sessionId: src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0 is DEAD
2025-10-01T14:15:15.600353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:15.600363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Write session will restart in 0.006550s
2025-10-01T14:15:15.600386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Write session: Do CDS request
2025-10-01T14:15:15.600391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:15.600893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:15.607134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:15.607847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.607892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:15.607911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2481
2025-10-01T14:15:15.608047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.608078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:15.608088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:15.608091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:15.608414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2481 sessionId:  describe result for acl check
2025-10-01T14:15:15.608445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:15.608449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:15.608451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:15.608455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256720935625703:3753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:15.608486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:15.608681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:15.608692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:15.608702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:15.608754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:15.608793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256718558705614:7892]
2025-10-01T14:15:15.608897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256720935625703:3753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:15.609363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:15.609750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:15.609793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:15.609998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:15.610034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.610038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.610039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.610039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.610040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.610041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.610041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.610042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.610043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.610043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.610044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.610045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.610045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.610046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.610051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.610056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.610060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.610062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.610064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.610066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.610068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.610070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.610072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.610074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.610076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.610078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.610080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.610082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.610087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.610091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.610096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.610099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.610101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.610104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.610108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.610111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.610113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.610115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.610117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.610120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.610122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.610128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.610130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.610133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.610138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.610141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.610144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.610147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.610152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.610155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.610157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.610160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.610163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.610165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.610167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.610170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.610190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:15.610816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256720935625703:3753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:15.613281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256720935625703:3753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:15.613295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256720935625703:3753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:15.613297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256720935625703:3753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:15.613307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:15.613448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:15.614024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:15.614038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:15.614039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:15.614041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:15.614046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2480 [2:7556256718558705614:7892]
2025-10-01T14:15:15.614063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:15.614075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:15.614077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.614079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.614081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.614092Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:15.614095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:15.614099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:15.614136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.614142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.614143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.614146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:15.614147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:15.614194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:15.614198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.614204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.614209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.614218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:15.614233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625672:2446], now have 1 active actors on pipe
2025-10-01T14:15:15.614239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625739:3753], now have 1 active actors on pipe
2025-10-01T14:15:15.614244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.614245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.614246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.614254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:15.614262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:15.614270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:15.614273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:15.614273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:15.614275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:15.614275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:15.614292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.614297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:15.614303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:15.614290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2480
2025-10-01T14:15:15.614322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2480
2025-10-01T14:15:15.614394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.614403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.614424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4298d408-c216e259-7816693f-f204fe7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:15.614434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.614439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.614441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:15.614449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.614463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:15.614479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.614630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.614643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.614666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.614753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2481 partition: 0 MaxSeqNo: 45 sessionId: src_id|4298d408-c216e259-7816693f-f204fe7a_0
2025-10-01T14:15:15.615036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8114f618-a4b4c6cd-543d56c1-3dcf2ebf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4298d408-c216e259-7816693f-f204fe7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:15.617679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Write session: try to update token
2025-10-01T14:15:15.617695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:15.624776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:15.624795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.624802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.624839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:15.624842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:15.624996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:15.625124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.625245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.625372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.625548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:15.625582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:15.632859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId: src_id|4298d408-c216e259-7816693f-f204fe7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:15.635582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:15.635818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.635842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.635883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:15.635973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:15.643063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:15.643086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.643088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:15.643089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:15.643098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.643101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.643104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256718558705609:7892]
2025-10-01T14:15:15.643144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:15.643147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:15.643153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:15.643154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.643156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:15.643157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:15.643285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:15.700240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256720935625749:5192]
2025-10-01T14:15:15.701617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2480, pipe: [1:7556256720935625749:5192]
2025-10-01T14:15:15.779407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:15.786122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.786152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.786294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.786355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.786435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.786493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.786535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.786542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.786599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.786652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.786707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.786765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.786807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.786812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.786872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.786928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.786984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.787041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.787080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.787085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.787146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.787207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.787263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.787322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.787362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.787367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.787435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.787509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.787574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.787636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.787688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.787695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.787766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.787837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.787904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.787973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.788021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.788027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.788087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.788141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.788205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.788266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.788304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.788310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.788375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.788429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.788491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.788563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.788608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.788613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.788672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.788726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.788781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.788838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.788880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.788885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.788942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.788996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.789052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.789107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.789146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.789151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.789194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625749:5192], now have 1 active actors on pipe
2025-10-01T14:15:15.789430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256720935625749:5192]
2025-10-01T14:15:15.789452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:15.789456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:15.789459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:15.789484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2481 reason: error at write: Disconnected sessionId: src_id|4298d408-c216e259-7816693f-f204fe7a_0
2025-10-01T14:15:15.789667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2481 sessionId: src_id|4298d408-c216e259-7816693f-f204fe7a_0 is DEAD
2025-10-01T14:15:15.789771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:15.789782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Write session will restart in 0.007123s
2025-10-01T14:15:15.789809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Write session: Do CDS request
2025-10-01T14:15:15.789814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:15.789942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:15.796305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:15.797579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:15.797762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:15.797777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:15.797789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:15.797841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:15.797880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.797882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256718558705694:7887]
2025-10-01T14:15:15.797992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:15.798020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2482
2025-10-01T14:15:15.798334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:15.798454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.798485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:15.798495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:15.798498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:15.798678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:15.798734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:15.798870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2482 sessionId:  describe result for acl check
2025-10-01T14:15:15.798899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:15.798905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:15.798907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:15.798912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256720935625784:3748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:15.799061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:15.799118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.799129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.799131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.799132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.799133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.799134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.799136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.799137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.799138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.799139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.799140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.799142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.799143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.799144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.799150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.799160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.799166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.799170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.799175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.799179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.799182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.799185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.799188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.799192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.799195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.799199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.799203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.799206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.799214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.799221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.799227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.799232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.799237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.799242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.799247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.799253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.799262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.799267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.799271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.799276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.799280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.799286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.799295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.799300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.799307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.799312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.799316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.799326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.799331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.799340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.799348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.799353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.799359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.799365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.799373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.799378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.799402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256720935625784:3748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:15.799424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:15.801627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256720935625784:3748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:15.803166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:15.803791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:15.803809Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:15.803811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:15.803815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:15.803821Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2481 [2:7556256718558705694:7887]
2025-10-01T14:15:15.803836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:15.803850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:15.803858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.803862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.803869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.803883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:15.803896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:15.803902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:15.803959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.803968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.803971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.803974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:15.803977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:15.804041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:15.804050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.804062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.804078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.804098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:15.804119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625752:2446], now have 1 active actors on pipe
2025-10-01T14:15:15.804131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.804137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.804139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.804152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:15.804128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2481
2025-10-01T14:15:15.804169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:15.804170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:15.804173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:15.804176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:15.804187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:15.804194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:15.804230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.804241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:15.804248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:15.804438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256720935625784:3748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:15.804449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256720935625784:3748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:15.804453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256720935625784:3748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:15.804459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:15.804653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625823:3748], now have 1 active actors on pipe
2025-10-01T14:15:15.804693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2481
2025-10-01T14:15:15.804738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.804745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.804764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:15.804774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.804781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.804784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:15.804791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.804805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:15.804823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.804980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.804985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.804994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:15.805069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2482 partition: 0 MaxSeqNo: 45 sessionId: src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0
2025-10-01T14:15:15.805396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4298d408-c216e259-7816693f-f204fe7a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:15.808519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Write session: try to update token
2025-10-01T14:15:15.808551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:15.814843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:15.814863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.814870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.814913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:15.814917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:15.815067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:15.815196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.815337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.815489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:15.815703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:15.815740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:15.823955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId: src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:15.826686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:15.826906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.826942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.826980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:15.827147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:15.832799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:15.832823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:15.832825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:15.832827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:15.832840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.832843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.832847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256718558705689:7887]
2025-10-01T14:15:15.832894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:15.832901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:15.832907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.832908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:15.832910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:15.832912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:15.833033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:15.889698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256720935625828:5192]
2025-10-01T14:15:15.889943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2481, pipe: [1:7556256720935625828:5192]
2025-10-01T14:15:15.972045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:15.978649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:15.978677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:15.978825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.978877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.978930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.978987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.979035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.979046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.979115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.982046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256720935625828:5192]
2025-10-01T14:15:15.982055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:15.982058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:15.982080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2482 reason: error at write: Disconnected sessionId: src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0
2025-10-01T14:15:15.982084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:15.982277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2482 sessionId: src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0 is DEAD
2025-10-01T14:15:15.982365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:15.979182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.982396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Write session will restart in 0.009884s
2025-10-01T14:15:15.979249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.979313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.979358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.982432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Write session: Do CDS request
2025-10-01T14:15:15.979361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.979437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.979514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.979583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.982438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:15.979649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.979692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.979695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.979778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.979842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.979903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.979959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.980002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.980005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.980071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.980130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.980189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.980247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.980286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.980289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.980356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.980413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.980469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.980527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.980581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.980589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.980652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.980706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.980765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.980829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.980866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.980871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.980935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.980988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.981043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.981102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.981140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.981143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.981200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.981253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.981307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.981363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.981488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.981491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.981548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:15.981603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:15.981659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:15.981712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:15.981756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:15.981758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:15.981807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625828:5192], now have 1 active actors on pipe
2025-10-01T14:15:15.982881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:15.988820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:15.990014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:15.990188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:15.990197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:15.990206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:15.990252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:15.990287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256718558705765:7882]
2025-10-01T14:15:15.990915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:15.991175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:15.991212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:15.991553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:15.991614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.991623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.991624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.991625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.991626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.991627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.991628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.991630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.991631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.991632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.991633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.991635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.991636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.991637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.991642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.991654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.991658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.991663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.991667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.991671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.991674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.991678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.991682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.991686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.991690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.991693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.991697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.991701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.991707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.991714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:15.991720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.991725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:15.991735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.991740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:15.991745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.991754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:15.991757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.991762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:15.991765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.991770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:15.991776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.991781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:15.991790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.991794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:15.991797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.991801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:15.991809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.991814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.991818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.991823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.991826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.991829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.991841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.991844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:15.991847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.991853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:15.991885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:15.993796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.993950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:15.993965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2483
2025-10-01T14:15:15.994063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:15.994107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:15.994119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:15.994122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:15.994476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2483 sessionId:  describe result for acl check
2025-10-01T14:15:15.994507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:15.994513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:15.994516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:15.994521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256720935625869:3731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:15.994987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256720935625869:3731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:15.995501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:15.996133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:15.996151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:15.996154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:15.996157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:15.996163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2482 [2:7556256718558705765:7882]
2025-10-01T14:15:15.996179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:15.996194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:15.996202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:15.996205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:15.996208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:15.996223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:15.996232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:15.996237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:15.996292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.996300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.996302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.996305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:15.996309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:15.996371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:15.996383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:15.996395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:15.996404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:15.996418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:15.996440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256720935625833:2446], now have 1 active actors on pipe
2025-10-01T14:15:15.996451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:15.996453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:15.996454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:15.996462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:15.996451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2482
2025-10-01T14:15:15.996468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:15.996475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:15.996475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:15.996477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:15.996489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:15.996491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:15.996522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:15.996535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:15.996560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:15.997695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256720935625869:3731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:16.003152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256720935625869:3731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:16.003171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256720935625869:3731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:16.003174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256720935625869:3731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:16.003180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:16.003397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2482
2025-10-01T14:15:16.003398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593200:3731], now have 1 active actors on pipe
2025-10-01T14:15:16.003437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.003445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.003473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:16.003487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.003492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.003497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:16.003508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.003524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:16.003542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.003663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.003674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.003688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.003791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2483 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0
2025-10-01T14:15:16.004100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153860ab-ed6f8365-daa4448c-20a09ca1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:16.006833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Write session: try to update token
2025-10-01T14:15:16.006847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:16.007502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:16.007521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.007530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:16.007561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:16.007574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:16.007734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:16.007880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.008013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.008149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.008340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:16.008376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:16.022129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId: src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:16.024899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:16.025983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.026008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.026026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:16.026028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.026030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:16.026031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:16.026038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:16.026041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:16.026043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256718558705760:7882]
2025-10-01T14:15:16.026073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:16.026085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:16.026086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:16.026087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:16.026090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.026091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:16.026204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:16.082190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256725230593218:5192]
2025-10-01T14:15:16.082444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2482, pipe: [1:7556256725230593218:5192]
2025-10-01T14:15:16.170566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:16.170876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:16.170908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593218:5192], now have 1 active actors on pipe
2025-10-01T14:15:16.171020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:16.171058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256725230593218:5192]
2025-10-01T14:15:16.171094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:16.171119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:16.171127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:16.171190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2483 reason: error at write: Disconnected sessionId: src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0
2025-10-01T14:15:16.171333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2483 sessionId: src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0 is DEAD
2025-10-01T14:15:16.171458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:16.171468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Write session will restart in 0.009359s
2025-10-01T14:15:16.171487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Write session: Do CDS request
2025-10-01T14:15:16.171494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:16.176844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:16.178114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:16.178272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:16.178280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:16.178288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:16.178323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:16.178355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256722853673132:7870]
2025-10-01T14:15:16.178812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:16.179123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:16.179171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:16.179409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:16.179454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.179459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.179459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.179460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.179461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.179462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.179462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.179463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.179464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.179464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.179465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.179466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.179466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.179468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.179471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.179478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.179480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.179483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.179489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.179492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.179494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.179496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.179498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.179501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.179503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.179506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.179509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.179513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.179519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.179526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.179534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.179538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.179541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.179544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.179547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.179550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.179554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.179557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.179560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.179563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.179565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.179568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.179571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.179573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.179577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.179579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.179582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.179585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.179587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.179590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.179593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.179596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.179598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.179601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.179603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.179605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.179626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:16.181801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.181944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:16.181965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2484
2025-10-01T14:15:16.182077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.182109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:16.182120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:16.182123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:16.182495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2484 sessionId:  describe result for acl check
2025-10-01T14:15:16.182528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:16.182531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:16.182532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:16.182537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256725230593269:3696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:16.183054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256725230593269:3696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:16.183243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:16.183811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:16.183832Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:16.183834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:16.183836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:16.183842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2483 [2:7556256722853673132:7870]
2025-10-01T14:15:16.183853Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:16.183867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:16.183868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.183875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.183876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.183887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:16.183898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:16.183905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:16.183944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.183951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.183952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.183954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:16.183956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:16.184005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:16.184010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.184017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.184022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.184032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:16.184047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593220:2446], now have 1 active actors on pipe
2025-10-01T14:15:16.184056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.184058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.184059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.184068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:16.184076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:16.184082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:16.184085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:16.184086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:16.184088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:16.184089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:16.184109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.184116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:16.184121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:16.184108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2483
2025-10-01T14:15:16.184721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256725230593269:3696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:16.190116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256725230593269:3696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:16.190128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256725230593269:3696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:16.190130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256725230593269:3696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:16.190135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:16.190516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593307:3696], now have 1 active actors on pipe
2025-10-01T14:15:16.190564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2483
2025-10-01T14:15:16.190614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.190626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.190646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:16.190657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.190664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.190666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:16.190674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.190691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:16.190708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.190847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.190853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.190862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.190954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2484 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0
2025-10-01T14:15:16.191242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5fd5bf-f3247dd5-6cd2d64a-619a8b40_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:16.193898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Write session: try to update token
2025-10-01T14:15:16.193914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:16.204693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:16.204715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.204716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:16.204718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:16.204725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.204728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.204732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256722853673127:7870]
2025-10-01T14:15:16.204770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:16.204777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.204778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:16.204795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:16.204801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:16.204806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:16.204900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:16.208467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId: src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:16.211109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:16.271149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256725230593321:5192]
2025-10-01T14:15:16.271400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2483, pipe: [1:7556256725230593321:5192]
2025-10-01T14:15:16.346424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:16.346721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.346740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.346783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593321:5192], now have 1 active actors on pipe
2025-10-01T14:15:16.346971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:16.346974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256725230593321:5192]
2025-10-01T14:15:16.346993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:16.346995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:16.347011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:16.347042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2484 reason: error at write: Disconnected sessionId: src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0
2025-10-01T14:15:16.347204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2484 sessionId: src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0 is DEAD
2025-10-01T14:15:16.347337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:16.347346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Write session will restart in 0.008974s
2025-10-01T14:15:16.347367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Write session: Do CDS request
2025-10-01T14:15:16.347372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:16.352440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:16.353547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:16.353690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:16.353698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:16.353706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:16.353739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:16.353768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256722853673212:7871]
2025-10-01T14:15:16.354136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:16.354356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:16.354403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:16.354643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:16.354704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.354711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.354712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.354713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.354714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.354715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.354716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.354717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.354718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.354720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.354721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.354722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.354723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.354724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.354728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.354738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.354742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.354746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.354750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.354752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.354754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.354756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.354757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.354759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.354761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.354763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.354765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.354766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.354771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.354775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.354779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.354783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.354787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.354790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.354792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.354795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.354799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.354801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.354804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.354806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.354809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.354811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.354813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.354816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.354818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.354820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.354823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.354825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.354827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.354830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.354832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.354835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.354837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.354839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.354841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.354843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.354862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:16.357810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.357886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:16.357903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2485
2025-10-01T14:15:16.358003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.358033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:16.358043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:16.358046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:16.358122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:16.358418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2485 sessionId:  describe result for acl check
2025-10-01T14:15:16.358455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:16.358461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:16.358463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:16.358468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256725230593371:3670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:16.358734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:16.358748Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:16.358749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:16.358752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:16.358757Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2484 [2:7556256722853673212:7871]
2025-10-01T14:15:16.358766Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:16.358780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:16.358782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.358785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.358786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.358798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:16.358801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:16.358805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:16.358848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.358856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.358857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.358860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:16.358863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:16.358909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:16.358915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.358922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.358928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.358936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:16.358948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593322:2446], now have 1 active actors on pipe
2025-10-01T14:15:16.358957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.358958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.358949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256725230593371:3670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:16.358959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.358969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:16.358982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:16.358987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:16.358989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2484
2025-10-01T14:15:16.358990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:16.358993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:16.358996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:16.358998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:16.359009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.359011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:16.359013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:16.361221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256725230593371:3670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:16.366077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256725230593371:3670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:16.366087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256725230593371:3670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:16.366089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256725230593371:3670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:16.366094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:16.366308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593410:3670], now have 1 active actors on pipe
2025-10-01T14:15:16.366339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2484
2025-10-01T14:15:16.366434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.366447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.366473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:16.366487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.366496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.366499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:16.366511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.366528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:16.366546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.366688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.366694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.366706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.366763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2485 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0
2025-10-01T14:15:16.367065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9bda8b-d3ddbf54-b8bf88-78fcdc2a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:16.369667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Write session: try to update token
2025-10-01T14:15:16.369681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:16.374184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:16.374205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.374216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.374263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:16.374268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:16.374462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:16.374616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.374752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.374896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.375084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:16.375125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:16.383499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId: src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:16.385945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:16.387645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.387673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.387697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:16.387701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.387706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:16.387708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:16.387717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.387721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.387725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256722853673207:7871]
2025-10-01T14:15:16.387781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:16.387793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.387799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:16.387805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:16.387811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:16.387814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:16.387934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:16.447257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256725230593414:5192]
2025-10-01T14:15:16.447481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2484, pipe: [1:7556256725230593414:5192]
2025-10-01T14:15:16.521453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:16.521666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:16.521698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593414:5192], now have 1 active actors on pipe
2025-10-01T14:15:16.521812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:16.521830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256725230593414:5192]
2025-10-01T14:15:16.521849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:16.521905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:16.521915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:16.521994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2485 reason: error at write: Disconnected sessionId: src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0
2025-10-01T14:15:16.522130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2485 sessionId: src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0 is DEAD
2025-10-01T14:15:16.522267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:16.522274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Write session will restart in 0.005908s
2025-10-01T14:15:16.522297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Write session: Do CDS request
2025-10-01T14:15:16.522302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:16.528877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.528968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:16.528989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2486
2025-10-01T14:15:16.529119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.529153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:16.529158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:16.529161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:16.529426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:16.529789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2486 sessionId:  describe result for acl check
2025-10-01T14:15:16.529821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:16.529822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:16.529824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:16.529829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256725230593453:3668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:16.530241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256725230593453:3668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:16.531045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:16.531232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:16.531241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:16.531253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:16.531305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:16.531342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256722853673284:7875]
2025-10-01T14:15:16.531860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256725230593453:3668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:16.531871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:16.532099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:16.532137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:16.532407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:16.532458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.532464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.532465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.532467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.532469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.532470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.532471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.532472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.532473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.532475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.532476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.532477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.532478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.532479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.532483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.532492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.532496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.532499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.532502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.532506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.532509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.532513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.532516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.532521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.532524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.532527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.532531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.532534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.532551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.532557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.532563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.532567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.532571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.532576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.532580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.532585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.532591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.532595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.532599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.532604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.532610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.532620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.532624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.532629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.532637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.532642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.532648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.532653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.532657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.532667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.532670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.532675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.532683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.532688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.532696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.532700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.532737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:16.536183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256725230593453:3668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:16.536197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256725230593453:3668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:16.536200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256725230593453:3668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:16.536213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:16.536384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:16.537031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:16.537045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:16.537048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:16.537051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:16.537058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2485 [2:7556256722853673284:7875]
2025-10-01T14:15:16.537073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:16.537094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:16.537101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.537106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.537109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.537123Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:16.537133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:16.537138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:16.537197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.537204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.537206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.537208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:16.537211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:16.537273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:16.537280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.537291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.537307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.537328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:16.537348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.537354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.537356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.537365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:16.537375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:16.537378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:16.537380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:16.537382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593418:2446], now have 1 active actors on pipe
2025-10-01T14:15:16.537391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:16.537407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:16.537410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:16.537416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593492:3668], now have 1 active actors on pipe
2025-10-01T14:15:16.537436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2485
2025-10-01T14:15:16.537445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.537451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2485
2025-10-01T14:15:16.537458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:16.537484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:16.537530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.537538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.537560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dffbe175-4a374165-e4f1baa6-57b62328_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:16.537570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.537578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.537580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:16.537588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.537599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:16.537615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.538093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.538112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.538133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.538212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2486 partition: 0 MaxSeqNo: 45 sessionId: src_id|dffbe175-4a374165-e4f1baa6-57b62328_0
2025-10-01T14:15:16.538667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39e44d-95f60ef3-a6c41213-91c04e03_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dffbe175-4a374165-e4f1baa6-57b62328_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:16.541687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Write session: try to update token
2025-10-01T14:15:16.541706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:16.554608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:16.554627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.554634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.554663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:16.554676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:16.554831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:16.554955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.555075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.555201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:16.555388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:16.555426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:16.555617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId: src_id|dffbe175-4a374165-e4f1baa6-57b62328_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:16.558003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:16.558159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.558176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.558209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:16.558270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:16.567957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:16.567979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.567982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:16.567983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:16.567996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.567999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.568002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256722853673279:7875]
2025-10-01T14:15:16.568044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:16.568049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:16.568055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.568057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:16.568070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:16.568074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:16.568183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:16.621850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256725230593507:5192]
2025-10-01T14:15:16.622115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2485, pipe: [1:7556256725230593507:5192]
2025-10-01T14:15:16.707425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:16.713985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.714012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.714145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.714197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.714258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.714317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.714355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.714364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.714436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.714483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.714542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.714597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.714636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.714642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.714701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.714753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.714812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.714863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.714901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.714908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.714966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.715025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.715079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.715128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.715167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.715172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.715230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.715288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.715339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.715391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.715427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.715432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.715486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.715544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.715597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.715652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.715692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.715697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.715749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.715809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.715863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.715913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.715951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.715957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.716010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.716072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.716130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.716182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.716244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.716249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.716307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.716359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.716408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.716459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.716496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.716501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.716568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:16.716619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:16.716671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:16.716722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:16.716764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:16.716769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:16.716815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593507:5192], now have 1 active actors on pipe
2025-10-01T14:15:16.717031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256725230593507:5192]
2025-10-01T14:15:16.717071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:16.717077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:16.717097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2486 reason: error at write: Disconnected sessionId: src_id|dffbe175-4a374165-e4f1baa6-57b62328_0
2025-10-01T14:15:16.717203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:16.717259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2486 sessionId: src_id|dffbe175-4a374165-e4f1baa6-57b62328_0 is DEAD
2025-10-01T14:15:16.717380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:16.717389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Write session will restart in 0.009154s
2025-10-01T14:15:16.717408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Write session: Do CDS request
2025-10-01T14:15:16.717413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:16.717614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:16.724184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:16.725696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:16.725875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:16.725885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:16.725895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:16.725938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:16.725978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256722853673400:7848]
2025-10-01T14:15:16.726556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:16.726920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:16.726959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:16.727241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:16.727287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.727291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.727293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.727294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.727295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.727296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.727297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.727299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.727300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.727301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.727302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.727303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.727304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.727306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.727310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.727320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.727324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.727328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.727336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.727339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.727347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.727351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.727358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.727361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.727369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.727372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.727380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.727385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.727395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.727406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.727415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.727421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.727428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.727433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.727441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.727446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.727453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.727460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.727468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.727473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.727477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.727482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.727486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.727490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.727498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.727503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.727511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.727515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.727519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.727527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.727531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.727540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.727547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.727555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.727560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.727567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.727592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:16.727875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.727978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:16.727992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2487
2025-10-01T14:15:16.728129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.728172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:16.728181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:16.728186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:16.728515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2487 sessionId:  describe result for acl check
2025-10-01T14:15:16.728551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:16.728557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:16.728559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:16.728562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256725230593549:3643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:16.728981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256725230593549:3643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:16.731113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:16.731117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256725230593549:3643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:16.731840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:16.731855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:16.731857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:16.731861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:16.731867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2486 [2:7556256722853673400:7848]
2025-10-01T14:15:16.731880Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:16.731896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:16.731898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.731901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.731904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.731918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:16.731923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:16.731934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:16.731984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.731993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.731994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.731997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:16.732000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:16.732059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:16.732066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.732077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.732092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.732111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:16.732134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593510:2446], now have 1 active actors on pipe
2025-10-01T14:15:16.732146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.732152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.732155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.732144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2486
2025-10-01T14:15:16.732168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:16.732180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:16.732184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:16.732190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:16.732192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:16.732197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:16.732199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:16.732227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.732238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:16.732250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:16.736822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256725230593549:3643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:16.736840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256725230593549:3643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:16.736844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256725230593549:3643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:16.736852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:16.737062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593588:3643], now have 1 active actors on pipe
2025-10-01T14:15:16.737137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2486
2025-10-01T14:15:16.737201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.737213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.737238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfb581e2-21157017-6b0840e6-20e009c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:16.737252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.737257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.737264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:16.737276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.737294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:16.737315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.737491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.737499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.737511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.737602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2487 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfb581e2-21157017-6b0840e6-20e009c_0
2025-10-01T14:15:16.737911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbe175-4a374165-e4f1baa6-57b62328_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfb581e2-21157017-6b0840e6-20e009c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:16.740750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Write session: try to update token
2025-10-01T14:15:16.740768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:16.752430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:16.752455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.752457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:16.752459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:16.752469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.752474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.752478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256722853673395:7848]
2025-10-01T14:15:16.752530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:16.752548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:16.752554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:16.752555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.752558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:16.752559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:16.752699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:16.754349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId: src_id|bfb581e2-21157017-6b0840e6-20e009c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:16.756795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:16.817448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256725230593592:5192]
2025-10-01T14:15:16.817694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2486, pipe: [1:7556256725230593592:5192]
2025-10-01T14:15:16.893588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:16.893875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.893890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.893933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593592:5192], now have 1 active actors on pipe
2025-10-01T14:15:16.894148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:16.894162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:16.894173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:16.894182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:16.894221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256725230593592:5192]
2025-10-01T14:15:16.894228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2487 reason: error at write: Disconnected sessionId: src_id|bfb581e2-21157017-6b0840e6-20e009c_0
2025-10-01T14:15:16.894415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2487 sessionId: src_id|bfb581e2-21157017-6b0840e6-20e009c_0 is DEAD
2025-10-01T14:15:16.894555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:16.894566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Write session will restart in 0.005996s
2025-10-01T14:15:16.894592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Write session: Do CDS request
2025-10-01T14:15:16.894597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:16.901844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.901920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:16.902191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:16.902201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2488
2025-10-01T14:15:16.902342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:16.902395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:16.902406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:16.902409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:16.903597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2488 sessionId:  describe result for acl check
2025-10-01T14:15:16.903641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:16.903644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:16.903653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:16.903655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:16.903661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256725230593630:3638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:16.903825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:16.903838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:16.903851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:16.903905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:16.903943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256722853673476:7842]
2025-10-01T14:15:16.904240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256725230593630:3638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:16.904489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:16.904795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:16.904860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:16.905181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:16.905267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.905272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.905274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.905275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.905276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.905277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.905278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.905279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.905281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.905282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.905285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.905286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.905288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.905289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.905294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.905303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.905306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.905310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.905313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.905316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.905319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.905322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.905326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.905330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.905334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.905337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.905341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.905344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.905352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.905360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:16.905365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.905370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:16.905375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.905380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:16.905384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.905389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:16.905393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.905398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:16.905404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.905409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:16.905413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.905419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:16.905424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.905428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:16.905432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.905436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:16.905439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.905444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.905448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.905453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.905462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.905466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.905470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.905479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:16.905483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.905491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:16.905530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:16.906249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256725230593630:3638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:16.908778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256725230593630:3638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:16.908791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256725230593630:3638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:16.908794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256725230593630:3638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:16.908802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:16.909058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:16.909702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:16.909730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:16.909732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:16.909735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:16.909741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2487 [2:7556256722853673476:7842]
2025-10-01T14:15:16.909792Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:16.909810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:16.909815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.909819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.909820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.909832Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:16.909836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:16.909839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:16.909885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.909889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.909890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.909893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:16.909894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:16.909949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:16.909954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.909961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:16.909966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:16.909979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:16.909994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593669:3638], now have 1 active actors on pipe
2025-10-01T14:15:16.910003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.910005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.910006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.910015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:16.910021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593593:2446], now have 1 active actors on pipe
2025-10-01T14:15:16.910024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:16.910027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:16.910028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:16.910030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:16.910038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:16.910040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:16.910064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.910070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:16.910071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:16.910047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2487
2025-10-01T14:15:16.910070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2487
2025-10-01T14:15:16.910089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.910096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.910117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:16.910128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:16.910132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:16.910134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:16.910142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:16.910148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:16.910166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.910410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:16.910423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:16.910444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:16.910521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2488 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0
2025-10-01T14:15:16.910888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb581e2-21157017-6b0840e6-20e009c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:16.913776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Write session: try to update token
2025-10-01T14:15:16.913796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:16.928191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId: src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:16.930193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:16.930220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:16.930222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:16.930225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:16.930235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.930239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.930243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256722853673471:7842]
2025-10-01T14:15:16.930292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:16.930298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:16.930298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:16.930302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:16.930454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:16.930476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:16.930482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:16.930724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:16.994611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256725230593677:5192]
2025-10-01T14:15:16.994876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2487, pipe: [1:7556256725230593677:5192]
2025-10-01T14:15:17.074847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:17.075189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.075204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.075244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256725230593677:5192], now have 1 active actors on pipe
2025-10-01T14:15:17.075431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:17.075444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:17.075457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:17.075459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256725230593677:5192]
2025-10-01T14:15:17.075480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:17.075499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2488 reason: error at write: Disconnected sessionId: src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0
2025-10-01T14:15:17.075642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2488 sessionId: src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0 is DEAD
2025-10-01T14:15:17.075752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:17.075760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Write session will restart in 0.005096s
2025-10-01T14:15:17.075796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Write session: Do CDS request
2025-10-01T14:15:17.075800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:17.081856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.081918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:17.081932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2489
2025-10-01T14:15:17.082079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.082115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:17.082125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:17.082131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:17.082116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:17.082553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2489 sessionId:  describe result for acl check
2025-10-01T14:15:17.082583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:17.082599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:17.082600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:17.082605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256729525561026:3631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:17.083108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256729525561026:3631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:17.083577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:17.083758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:17.083766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:17.083776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:17.083822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:17.083862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256727148640847:7846]
2025-10-01T14:15:17.084396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:17.084677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:17.084711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:17.084882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256729525561026:3631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:17.084973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:17.085043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.085048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.085049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.085050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.085051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.085052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.085053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.085054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.085054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.085055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.085056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.085057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.085058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.085059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.085063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.085071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.085074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.085077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.085083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.085086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.085089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.085092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.085094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.085098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.085100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.085103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.085106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.085109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.085115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.085122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.085127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.085131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.085135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.085139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.085143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.085147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.085151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.085155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.085159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.085165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.085169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.085173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.085177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.085182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.085186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.085195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.085199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.085203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.085211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.085216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.085219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.085227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.085230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.085234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.085241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.085244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.085277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:17.088594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256729525561026:3631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:17.088607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256729525561026:3631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:17.088611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256729525561026:3631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:17.088622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:17.088805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:17.089462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:17.089483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:17.089485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:17.089489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:17.089495Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2488 [2:7556256727148640847:7846]
2025-10-01T14:15:17.089509Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:17.089526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:17.089534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.089537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.089540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.089555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:17.089565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:17.089570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:17.089632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.089646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.089648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.089651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:17.089653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:17.089720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:17.089727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.089738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.089748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.089763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:17.089784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561066:3631], now have 1 active actors on pipe
2025-10-01T14:15:17.089792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525560989:2446], now have 1 active actors on pipe
2025-10-01T14:15:17.089798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.089801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.089803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.089818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:17.089835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:17.089835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:17.089838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:17.089824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2488
2025-10-01T14:15:17.089840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:17.089849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:17.089827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2488
2025-10-01T14:15:17.089852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:17.089881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.089894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:17.089899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:17.089912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.089922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.090050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59633173-5654e2ad-52c12e34-d4c7badf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:17.090066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.090074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.090076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:17.090083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.090097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:17.090124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.090273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.090291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.090311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.090395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2489 partition: 0 MaxSeqNo: 45 sessionId: src_id|59633173-5654e2ad-52c12e34-d4c7badf_0
2025-10-01T14:15:17.090754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad930064-338a8f97-9ec3303f-2cb597c3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59633173-5654e2ad-52c12e34-d4c7badf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:17.093506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Write session: try to update token
2025-10-01T14:15:17.093524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:17.107183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId: src_id|59633173-5654e2ad-52c12e34-d4c7badf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:17.109601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:17.110520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.110545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.110566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:17.110569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.110571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:17.110574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:17.110582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.110587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.110591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256727148640842:7846]
2025-10-01T14:15:17.110634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:17.110648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:17.110650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:17.110653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:17.110655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.110658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:17.110799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:17.175855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256729525561076:5192]
2025-10-01T14:15:17.176157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2488, pipe: [1:7556256729525561076:5192]
2025-10-01T14:15:17.255981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:17.256196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:17.256245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561076:5192], now have 1 active actors on pipe
2025-10-01T14:15:17.256292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:17.256468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:17.256511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256729525561076:5192]
2025-10-01T14:15:17.263420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:17.264800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:17.264977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:17.264986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:17.264996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:17.265051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:17.265093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256727148640932:7838]
2025-10-01T14:15:17.265577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:17.265847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:17.265902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:17.266127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:17.266168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.266172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.266173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.266173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.266174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.266175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.266176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.266176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.266177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.266178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.266178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.266179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.266179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.266180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.266191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.266198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.266200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.266202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.266204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.266207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.266209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.266211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.266213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.266215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.266219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.266221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.266223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.266225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.266230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.266234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.266238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.266241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.266243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.266246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.266248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.266251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.266254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.266256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.266258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.266261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.266265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.266268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.266271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.266273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.266276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.266278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.266281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.266283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.266286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.266289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.266292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.266295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.266297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.266299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.266301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.266304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.266327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:17.266960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:17.266972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:17.266992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2489 reason: error at write: Disconnected sessionId: src_id|59633173-5654e2ad-52c12e34-d4c7badf_0
2025-10-01T14:15:17.267127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2489 sessionId: src_id|59633173-5654e2ad-52c12e34-d4c7badf_0 is DEAD
2025-10-01T14:15:17.267251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:17.267263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Write session will restart in 0.008177s
2025-10-01T14:15:17.267287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Write session: Do CDS request
2025-10-01T14:15:17.267292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:17.273232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:17.273924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:17.273937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:17.273941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:17.273944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:17.273949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2489 [2:7556256727148640932:7838]
2025-10-01T14:15:17.273961Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:17.273973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:17.273975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.273980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.273981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.273994Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:17.273997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:17.274003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:17.274044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.274050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.274051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.274053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:17.274055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:17.274118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:17.274126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.274136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.274146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.274163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:17.274183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561104:2446], now have 1 active actors on pipe
2025-10-01T14:15:17.274193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.274194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.274195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.274207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:17.274218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:17.274222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:17.274227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:17.274229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:17.274235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:17.274238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:17.274274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.274282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:17.274290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:17.274650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2489
2025-10-01T14:15:17.276856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.276963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:17.276974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2490
2025-10-01T14:15:17.277097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.277127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:17.277138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:17.277142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:17.278061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2490 sessionId:  describe result for acl check
2025-10-01T14:15:17.278092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:17.278094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:17.278096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:17.278099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256729525561151:3591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:17.278534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256729525561151:3591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:17.281101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256729525561151:3591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:17.284651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256729525561151:3591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:17.284666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256729525561151:3591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:17.284670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256729525561151:3591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:17.284679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:17.284973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2489
2025-10-01T14:15:17.285111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561184:3591], now have 1 active actors on pipe
2025-10-01T14:15:17.285139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.285147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.285165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:17.285168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.285177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.285213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:17.285222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:17.285232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.285242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.285244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:17.285256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.285275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:17.285293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:17.285452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:17.285575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.285700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.285823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.286029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:17.286069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.286095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:17.286274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.286284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.286299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.286391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2490 partition: 0 MaxSeqNo: 45 sessionId: src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0
2025-10-01T14:15:17.286771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59633173-5654e2ad-52c12e34-d4c7badf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:17.289743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Write session: try to update token
2025-10-01T14:15:17.289765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:17.304274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:17.304291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.304294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:17.304298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:17.304313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.304321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.304324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256727148640927:7838]
2025-10-01T14:15:17.304367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:17.304374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:17.304381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.304384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:17.304387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:17.304391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:17.304515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:17.306168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId: src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:17.308686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:17.356593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256729525561185:5192]
2025-10-01T14:15:17.356857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2489, pipe: [1:7556256729525561185:5192]
2025-10-01T14:15:17.446260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:17.446560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.446576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.446599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561185:5192], now have 1 active actors on pipe
2025-10-01T14:15:17.446791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:17.446852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:17.446917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:17.446943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0
2025-10-01T14:15:17.446965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256729525561185:5192]
2025-10-01T14:15:17.447128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2490 sessionId: src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0 is DEAD
2025-10-01T14:15:17.447272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:17.447282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Write session will restart in 0.006395s
2025-10-01T14:15:17.447308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Write session: Do CDS request
2025-10-01T14:15:17.447314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:17.453801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:17.455241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:17.455496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:17.455504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:17.455513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:17.455554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:17.455566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.455583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256727148641009:7833]
2025-10-01T14:15:17.455646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:17.455659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2491
2025-10-01T14:15:17.455778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.455805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:17.455823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:17.455827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:17.455961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:17.456139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2491 sessionId:  describe result for acl check
2025-10-01T14:15:17.456151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:17.456162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:17.456166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:17.456169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:17.456172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256729525561229:3574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:17.456174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:17.456384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:17.456419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.456423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.456424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.456425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.456425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.456428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.456428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.456429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.456430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.456430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.456431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.456431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.456432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.456432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.456435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.456441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.456443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.456445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.456447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.456449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.456451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.456453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.456455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.456457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.456459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.456461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.456463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.456465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.456469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.456473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.456477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.456480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.456482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.456485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.456488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.456491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.456494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.456496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.456499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.456501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.456503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.456506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.456508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.456511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.456513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.456516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.456519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.456522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.456525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.456527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.456530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.456533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.456551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.456553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.456555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.456603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256729525561229:3574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:17.456558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.456576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:17.458539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256729525561229:3574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:17.459903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:17.460476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:17.460486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:17.460487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:17.460491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:17.460496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2490 [2:7556256727148641009:7833]
2025-10-01T14:15:17.460506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:17.460519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:17.460527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.460529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.460530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.460555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:17.460558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:17.460563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:17.460600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.460605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.460606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.460608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:17.460610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:17.460656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:17.460661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.460667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.460672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.460681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:17.460694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561188:2446], now have 1 active actors on pipe
2025-10-01T14:15:17.460704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.460705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.460706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.460721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:17.460733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:17.460748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:17.460727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2490
2025-10-01T14:15:17.460754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:17.460755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:17.460758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:17.460759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:17.460779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.460803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:17.460812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:17.461110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256729525561229:3574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:17.461123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256729525561229:3574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:17.461126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256729525561229:3574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:17.461133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:17.461329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561268:3574], now have 1 active actors on pipe
2025-10-01T14:15:17.461373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2490
2025-10-01T14:15:17.461453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.461466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.461500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:17.461511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.461514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.461517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:17.461524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.461535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:17.461550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.461698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.461707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.461720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.461796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2491 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0
2025-10-01T14:15:17.462105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e81dab-6cc4bc49-ff669153-fb38d603_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:17.465119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Write session: try to update token
2025-10-01T14:15:17.465141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:17.471265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:17.471284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.471293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.471324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:17.471334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:17.471493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:17.471630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.471759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.471892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.472086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:17.472122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:17.478923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId: src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:17.481534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:17.481806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.481828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.481868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:17.481975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:17.489143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:17.489157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.489159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:17.489161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:17.489176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.489180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.489183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256727148641004:7833]
2025-10-01T14:15:17.489226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:17.489228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:17.489233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:17.489236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:17.489237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.489240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:17.489362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:17.547027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256729525561276:5192]
2025-10-01T14:15:17.547248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2490, pipe: [1:7556256729525561276:5192]
2025-10-01T14:15:17.626915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:17.634098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.634120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.634248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.634300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.634349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.634420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.634701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.634711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.634766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.634820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.634870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.634935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.634986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.634995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.635065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.635130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.635195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.635265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.635306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.635313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.635383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.635451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.635517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.635581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.635622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.635627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.635684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.635737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.635794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.635847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.635889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.635897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.635964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.636018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.636072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.636128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.636168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.636173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.636229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.636280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.636336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.636401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.636447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.636452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.636510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.636579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.636633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.636684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.636721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.636726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.636778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.636827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.636878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.636928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.636965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.636970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.637020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:17.637065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:17.637113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:17.637166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:17.637206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:17.637210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:17.637259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561276:5192], now have 1 active actors on pipe
2025-10-01T14:15:17.637436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:17.637452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:17.637457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:17.637483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2491 reason: error at write: Disconnected sessionId: src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0
2025-10-01T14:15:17.637504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256729525561276:5192]
2025-10-01T14:15:17.637665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2491 sessionId: src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0 is DEAD
2025-10-01T14:15:17.637784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:17.637792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Write session will restart in 0.009738s
2025-10-01T14:15:17.637810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Write session: Do CDS request
2025-10-01T14:15:17.637814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:17.637952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:17.644175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:17.645566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:17.645737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:17.645746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:17.645754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:17.645791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:17.645825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256727148641128:7819]
2025-10-01T14:15:17.646222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:17.646573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:17.646623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:17.646926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:17.646976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.646982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.646983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.646985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.646986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.646987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.646988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.646989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.646990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.646991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.646992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.646993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.646994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.646995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.647000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.647010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.647013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.647017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.647021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.647025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.647029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.647032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.647036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.647039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.647043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.647047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.647050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.647054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.647061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.647068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.647073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.647078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.647082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.647086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.647091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.647096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.647099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.647104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.647109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.647117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.647121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.647125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.647131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.647135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.647139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.647144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.647148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.647158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.647163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.647167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.647171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.647179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.647183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.647187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.647190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.647195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.647231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:17.648879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.648938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:17.648950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2492
2025-10-01T14:15:17.649055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.649091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:17.649101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:17.649104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:17.649494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2492 sessionId:  describe result for acl check
2025-10-01T14:15:17.649525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:17.649531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:17.649532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:17.649538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256729525561331:3557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:17.650021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256729525561331:3557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:17.650746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:17.651509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:17.651522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:17.651524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:17.651527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:17.651533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2491 [2:7556256727148641128:7819]
2025-10-01T14:15:17.651550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:17.651567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:17.651577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.651581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.651583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.651598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:17.651607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:17.651613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:17.651663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.651669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.651671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.651674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:17.651676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:17.651736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:17.651743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.651755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.651768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.651787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:17.651810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561286:2446], now have 1 active actors on pipe
2025-10-01T14:15:17.651821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.651827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.651829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.651841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:17.651859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:17.651841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2491
2025-10-01T14:15:17.651866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:17.651869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:17.651871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:17.651877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:17.651879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:17.651910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.651916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:17.651927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:17.652372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256729525561331:3557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:17.658258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256729525561331:3557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:17.658270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256729525561331:3557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:17.658274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256729525561331:3557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:17.658281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:17.658527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561366:3557], now have 1 active actors on pipe
2025-10-01T14:15:17.658571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2491
2025-10-01T14:15:17.658634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.658647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.658677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a55b587-cd1e4023-58af353-3a598484_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:17.658692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.658701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.658704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:17.658717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.658733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:17.658755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.658882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.658888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.658900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.658948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2492 partition: 0 MaxSeqNo: 45 sessionId: src_id|5a55b587-cd1e4023-58af353-3a598484_0
2025-10-01T14:15:17.659260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b60b7f-e644b29c-e0b9a2b4-8daa5634_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5a55b587-cd1e4023-58af353-3a598484_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:17.662165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Write session: try to update token
2025-10-01T14:15:17.662178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:17.662400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:17.662412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.662422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.662460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:17.662464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:17.662620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:17.662760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.662892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.663030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.663214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:17.663250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:17.677240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId: src_id|5a55b587-cd1e4023-58af353-3a598484_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:17.679707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:17.681205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.681227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.681248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:17.681254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.681258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:17.681260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:17.681269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.681272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.681275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256727148641123:7819]
2025-10-01T14:15:17.681315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:17.681327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:17.681328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:17.681332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:17.681334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.681336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:17.681466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:17.737504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256729525561369:5192]
2025-10-01T14:15:17.737798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2491, pipe: [1:7556256729525561369:5192]
2025-10-01T14:15:17.821873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:17.822164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:17.822196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561369:5192], now have 1 active actors on pipe
2025-10-01T14:15:17.822282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:17.822330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:17.822386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256729525561369:5192]
2025-10-01T14:15:17.822389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:17.822392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:17.822458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2492 reason: error at write: Disconnected sessionId: src_id|5a55b587-cd1e4023-58af353-3a598484_0
2025-10-01T14:15:17.822578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2492 sessionId: src_id|5a55b587-cd1e4023-58af353-3a598484_0 is DEAD
2025-10-01T14:15:17.822680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:17.822687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Write session will restart in 0.009450s
2025-10-01T14:15:17.822712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Write session: Do CDS request
2025-10-01T14:15:17.822719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:17.828506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:17.829666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:17.829826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:17.829836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:17.829846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:17.829888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:17.829923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256727148641209:7817]
2025-10-01T14:15:17.830503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:17.830745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:17.830784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:17.831070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:17.831121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.831127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.831128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.831129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.831130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.831131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.831132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.831133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.831134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.831135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.831136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.831137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.831138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.831141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.831146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.831155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.831159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.831163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.831165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.831169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.831173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.831177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.831180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.831183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.831187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.831190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.831193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.831197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.831204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.831211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:17.831216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.831221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:17.831225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.831230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:17.831234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.831239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:17.831244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.831250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:17.831258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.831263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:17.831267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.831277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:17.831281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.831286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:17.831292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.831300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:17.831304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.831308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.831312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.831318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.831326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.831331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.831340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.831344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:17.831352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.831357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:17.831392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:17.832839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.832937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:17.832946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2493
2025-10-01T14:15:17.833060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:17.833083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:17.833087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:17.833089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:17.833452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2493 sessionId:  describe result for acl check
2025-10-01T14:15:17.833483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:17.833489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:17.833491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:17.833496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256729525561417:3550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:17.833978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256729525561417:3550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:17.834822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:17.835522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:17.835536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:17.835539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:17.835542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:17.835548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2492 [2:7556256727148641209:7817]
2025-10-01T14:15:17.835562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:17.835576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:17.835579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.835582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.835585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.835599Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:17.835609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:17.835615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:17.835665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.835672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.835673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.835676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:17.835678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:17.835736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:17.835743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.835753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:17.835763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:17.835782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:17.835803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561372:2446], now have 1 active actors on pipe
2025-10-01T14:15:17.835816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.835822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.835823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.835795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2492
2025-10-01T14:15:17.835833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:17.835839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:17.835843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:17.835845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:17.835850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:17.835863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:17.835869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:17.835897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.835908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:17.835918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:17.835945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256729525561417:3550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:17.840694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256729525561417:3550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:17.840708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256729525561417:3550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:17.840711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256729525561417:3550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:17.840718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:17.840969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2492
2025-10-01T14:15:17.840950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561456:3550], now have 1 active actors on pipe
2025-10-01T14:15:17.841028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.841040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.841065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:17.841081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:17.841089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:17.841092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:17.841103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:17.841118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:17.841136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.841261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:17.841271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:17.841283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:17.841389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2493 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0
2025-10-01T14:15:17.841790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a55b587-cd1e4023-58af353-3a598484_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:17.844756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Write session: try to update token
2025-10-01T14:15:17.844776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:17.846553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:17.846567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.846576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.846617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:17.846621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:17.846775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:17.846914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.847049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.847180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:17.847356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:17.847394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:17.864085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId: src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:17.864568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:17.864585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:17.864588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:17.864590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:17.864599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.864603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.864609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256727148641204:7817]
2025-10-01T14:15:17.864646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:17.864654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:17.864657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:17.864660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:17.864661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:17.864664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:17.864800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:17.866315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:17.922345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256729525561460:5192]
2025-10-01T14:15:17.922641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2492, pipe: [1:7556256729525561460:5192]
2025-10-01T14:15:18.001955Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:18.002219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.002230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.002248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256729525561460:5192], now have 1 active actors on pipe
2025-10-01T14:15:18.002431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:18.002421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:18.002452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256729525561460:5192]
2025-10-01T14:15:18.002469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:18.002471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:18.002591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2493 reason: error at write: Disconnected sessionId: src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0
2025-10-01T14:15:18.002735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2493 sessionId: src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0 is DEAD
2025-10-01T14:15:18.002883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:18.002894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Write session will restart in 0.008233s
2025-10-01T14:15:18.002930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Write session: Do CDS request
2025-10-01T14:15:18.002936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:18.008865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:18.010324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:18.010518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:18.010527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:18.010536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:18.010577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:18.010611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256731443608585:7812]
2025-10-01T14:15:18.011011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:18.011278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:18.011308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:18.011533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:18.011568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.011572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.011573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.011573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.011574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.011575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.011575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.011576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.011577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.011577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.011579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.011580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.011581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.011581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.011584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.011590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.011592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.011594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.011596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.011598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.011600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.011602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.011604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.011606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.011608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.011610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.011612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.011614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.011619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.011623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.011627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.011630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.011634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.011637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.011640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.011643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.011645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.011647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.011649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.011652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.011654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.011657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.011660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.011663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.011665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.011668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.011670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.011672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.011674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.011677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.011679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.011682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.011684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.011686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.011689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.011691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.011712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:18.011859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.011923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:18.011934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2494
2025-10-01T14:15:18.012040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.012068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:18.012078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:18.012084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:18.012379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2494 sessionId:  describe result for acl check
2025-10-01T14:15:18.012401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:18.012403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:18.012405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:18.012409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256733820528806:3516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:18.012880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256733820528806:3516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:18.014547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256733820528806:3516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:18.015074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:18.015700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:18.015710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:18.015712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:18.015715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:18.015719Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2493 [2:7556256731443608585:7812]
2025-10-01T14:15:18.015731Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:18.015746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:18.015749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.015752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.015754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.015765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:18.015771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:18.015776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:18.015823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.015829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.015830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.015832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:18.015833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:18.015881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:18.015888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.015898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.015908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.015927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:18.015946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528758:2446], now have 1 active actors on pipe
2025-10-01T14:15:18.015956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.015958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.015959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.015971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:18.015984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:18.015977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2493
2025-10-01T14:15:18.015986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:18.015991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:18.015993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:18.016000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:18.016003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:18.016026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.016037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:18.016047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:18.016459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256733820528806:3516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:18.016471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256733820528806:3516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:18.016474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256733820528806:3516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:18.016479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:18.016640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528843:3516], now have 1 active actors on pipe
2025-10-01T14:15:18.016674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2493
2025-10-01T14:15:18.016720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.016729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.016745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:18.016754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.016760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.016763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:18.016769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.016778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:18.016791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.016906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.016913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.016924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.016977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2494 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0
2025-10-01T14:15:18.017241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c855d-6f16016f-7a751b05-4acb3cff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:18.020135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Write session: try to update token
2025-10-01T14:15:18.020152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:18.026288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:18.026306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.026321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.026366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:18.026383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:18.026582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:18.026744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:18.026897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:18.027059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:18.027273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:18.027316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:18.035196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId: src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:18.037595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:18.037779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.037799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.037836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:18.037910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:18.045064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:18.045079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.045081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:18.045082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:18.045093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.045098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.045101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256731443608580:7812]
2025-10-01T14:15:18.045146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:18.045150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:18.045157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:18.045157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.045160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:18.045160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:18.045288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:18.102572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256733820528861:5192]
2025-10-01T14:15:18.102832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2493, pipe: [1:7556256733820528861:5192]
2025-10-01T14:15:18.178875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:18.185643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.185666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.185796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.185846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.185936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.185987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.186394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.186406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.186466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.186515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.186568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.186621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.186660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.186665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.186722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.186775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.186830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.186888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.186930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.186935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.186992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.187048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.187106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.187162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.187202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.187207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.187264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.187317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.187373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.187435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.187476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.187481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.187537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.187589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.187646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.187700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.187739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.187743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.187804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.187855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.187910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.187962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.188002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.188007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.188063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.188117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.188174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.188231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.188269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.188274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.188327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.188378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.188431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.188483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.188522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.188527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.188592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.188639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.188691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.188743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.188786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.188791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.188832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528861:5192], now have 1 active actors on pipe
2025-10-01T14:15:18.189068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256733820528861:5192]
2025-10-01T14:15:18.189090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:18.189167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:18.189246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:18.189294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0
2025-10-01T14:15:18.189487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2494 sessionId: src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0 is DEAD
2025-10-01T14:15:18.189571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:18.189579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Write session will restart in 0.006416s
2025-10-01T14:15:18.189596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Write session: Do CDS request
2025-10-01T14:15:18.189601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:18.195908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:18.196804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.196899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:18.196911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2495
2025-10-01T14:15:18.197005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.197036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:18.197046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:18.197049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:18.197103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:18.197253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:18.197263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:18.197272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:18.197313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:18.197346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256731443608666:7808]
2025-10-01T14:15:18.197345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2495 sessionId:  describe result for acl check
2025-10-01T14:15:18.197370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:18.197375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:18.197376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:18.197380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256733820528906:3506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:18.197734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256733820528906:3506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:18.197738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:18.197964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:18.197995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:18.198183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:18.198216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.198220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.198220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.198221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.198221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.198222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.198223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.198223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.198224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.198224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.198225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.198225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.198226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.198227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.198229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.198234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.198237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.198239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.198241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.198243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.198245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.198247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.198249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.198251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.198253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.198255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.198257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.198261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.198266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.198272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.198278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.198282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.198286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.198291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.198300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.198308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.198316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.198320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.198326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.198330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.198337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.198341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.198347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.198351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.198359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.198367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.198385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.198389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.198394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.198399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.198402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.198406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.198414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.198418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.198422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.198429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.198465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:18.199987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256733820528906:3506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:18.201622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:18.201855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256733820528906:3506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:18.201865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256733820528906:3506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:18.201867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256733820528906:3506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:18.201872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:18.202236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:18.202248Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:18.202250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:18.202252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:18.202257Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2494 [2:7556256731443608666:7808]
2025-10-01T14:15:18.202269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:18.202284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:18.202292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.202295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.202297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.202311Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:18.202320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:18.202325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:18.202385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.202395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.202397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.202400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:18.202402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:18.202452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:18.202458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.202465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.202470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.202479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:18.202498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528863:2446], now have 1 active actors on pipe
2025-10-01T14:15:18.202501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528945:3506], now have 1 active actors on pipe
2025-10-01T14:15:18.202507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.202508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.202512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.202524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:18.202535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:18.202536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:18.202541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:18.202543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:18.202547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:18.202549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:18.202549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2494
2025-10-01T14:15:18.202567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.202574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:18.202573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2494
2025-10-01T14:15:18.202582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:18.202594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.202601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.202630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|946f09a7-a6624bb-1a207448-e38dced8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:18.202639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.202643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.202649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:18.202659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.202666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:18.202685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.202797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.202805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.202818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.202908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2495 partition: 0 MaxSeqNo: 45 sessionId: src_id|946f09a7-a6624bb-1a207448-e38dced8_0
2025-10-01T14:15:18.203159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c25aad-75dfe4b3-54b4847f-82ce1d79_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|946f09a7-a6624bb-1a207448-e38dced8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:18.206727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Write session: try to update token
2025-10-01T14:15:18.206747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:18.221476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId: src_id|946f09a7-a6624bb-1a207448-e38dced8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:18.221924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:18.221942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.221945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:18.221946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:18.221955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.221959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.221967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256731443608661:7808]
2025-10-01T14:15:18.222014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:18.222015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:18.222021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.222023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:18.222025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:18.222029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:18.222149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:18.223772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:18.289466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256733820528966:5192]
2025-10-01T14:15:18.289762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2494, pipe: [1:7556256733820528966:5192]
2025-10-01T14:15:18.354493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:18.354707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.354718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.354752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528966:5192], now have 1 active actors on pipe
2025-10-01T14:15:18.354905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:18.354966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:18.354977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:18.355018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:18.355023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2495 reason: error at write: Disconnected sessionId: src_id|946f09a7-a6624bb-1a207448-e38dced8_0
2025-10-01T14:15:18.355068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256733820528966:5192]
2025-10-01T14:15:18.355171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2495 sessionId: src_id|946f09a7-a6624bb-1a207448-e38dced8_0 is DEAD
2025-10-01T14:15:18.355299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:18.355306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Write session will restart in 0.008360s
2025-10-01T14:15:18.355325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Write session: Do CDS request
2025-10-01T14:15:18.355329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:18.361750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:18.363150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:18.363340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:18.363349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:18.363359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:18.363400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:18.363443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256731443608757:7801]
2025-10-01T14:15:18.364002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:18.364223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:18.364260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:18.364551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:18.364604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.364610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.364611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.364612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.364613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.364614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.364615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.364617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.364618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.364619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.364620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.364621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.364622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.364623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.364627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.364637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.364641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.364645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.364648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.364652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.364655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.364659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.364662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.364666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.364670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.364673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.364677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.364680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.364686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.364694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.364699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.364705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.364710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.364719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.364723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.364732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.364737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.364745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.364749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.364753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.364762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.364766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.364774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.364778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.364786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.364791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.364799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.364804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.364812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.364817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.364825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.364833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.364837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.364841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.364849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.364854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.364895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:18.364933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.365017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:18.365029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2496
2025-10-01T14:15:18.365132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.365158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:18.365167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:18.365171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:18.365455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2496 sessionId:  describe result for acl check
2025-10-01T14:15:18.365482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:18.365487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:18.365488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:18.365491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256733820529025:3463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:18.365937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256733820529025:3463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:18.368519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:18.368758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256733820529025:3463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:18.369336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:18.369350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:18.369353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:18.369358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:18.369365Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2495 [2:7556256731443608757:7801]
2025-10-01T14:15:18.369379Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:18.369394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:18.369397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.369400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.369402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.369417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:18.369426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:18.369432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:18.369484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.369491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.369492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.369495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:18.369497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:18.369556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:18.369563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.369574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.369579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.369588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:18.369605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820528976:2446], now have 1 active actors on pipe
2025-10-01T14:15:18.369614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.369615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.369616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.369623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:18.369633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:18.369633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:18.369637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:18.369639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:18.369643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:18.369645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:18.369665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.369669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:18.369672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:18.369664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2495
2025-10-01T14:15:18.374347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256733820529025:3463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:18.374361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256733820529025:3463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:18.374365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256733820529025:3463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:18.374387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:18.374608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529064:3463], now have 1 active actors on pipe
2025-10-01T14:15:18.374651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2495
2025-10-01T14:15:18.374688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.374702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.374734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:18.374747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.374750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.374752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:18.374760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.374773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:18.374794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.374945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.374950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.374960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.375058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2496 partition: 0 MaxSeqNo: 45 sessionId: src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0
2025-10-01T14:15:18.375378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f09a7-a6624bb-1a207448-e38dced8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:18.378098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Write session: try to update token
2025-10-01T14:15:18.378112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:18.389993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:18.390017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.390021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:18.390023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:18.390033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.390038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.390041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256731443608752:7801]
2025-10-01T14:15:18.390079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:18.390088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:18.390089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:18.390091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:18.390095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.390097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:18.390238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:18.391248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId: src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:18.393685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:18.455355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256733820529068:5192]
2025-10-01T14:15:18.455597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2495, pipe: [1:7556256733820529068:5192]
2025-10-01T14:15:18.531296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:18.531534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.531547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.531588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529068:5192], now have 1 active actors on pipe
2025-10-01T14:15:18.531771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:18.531798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256733820529068:5192]
2025-10-01T14:15:18.531817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:18.531825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:18.531891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0
2025-10-01T14:15:18.532067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2496 sessionId: src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0 is DEAD
2025-10-01T14:15:18.532188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:18.532199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Write session will restart in 0.006657s
2025-10-01T14:15:18.532228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Write session: Do CDS request
2025-10-01T14:15:18.532233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:18.538900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:18.539874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.539881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:18.539893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2497
2025-10-01T14:15:18.540067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.540098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:18.540107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:18.540110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:18.540292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:18.540424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:18.540432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:18.540441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:18.540472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:18.540499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256731443608840:7792]
2025-10-01T14:15:18.540553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2497 sessionId:  describe result for acl check
2025-10-01T14:15:18.540586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:18.540591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:18.540593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:18.540599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256733820529117:3461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:18.540925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:18.541074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256733820529117:3461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:18.541162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:18.541191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:18.541453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:18.541494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.541499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.541500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.541501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.541501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.541502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.541503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.541503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.541504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.541504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.541505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.541506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.541506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.541507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.541510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.541515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.541517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.541520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.541522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.541524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.541527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.541529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.541531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.541533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.541535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.541537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.541539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.541541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.541546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.541550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.541554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.541557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.541561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.541564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.541568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.541571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.541574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.541577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.541579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.541582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.541585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.541588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.541591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.541594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.541599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.541602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.541604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.541607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.541611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.541616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.541621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.541625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.541630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.541634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.541638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.541664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:18.542909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256733820529117:3461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:18.544973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256733820529117:3461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:18.544983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256733820529117:3461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:18.544986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256733820529117:3461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:18.544993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:18.545284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:18.546018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:18.546034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:18.546036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:18.546040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:18.546046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2496 [2:7556256731443608840:7792]
2025-10-01T14:15:18.546063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:18.546082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:18.546090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.546093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.546095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.546110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:18.546119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:18.546125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:18.546182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.546188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.546190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.546192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:18.546194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:18.546334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:18.546343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.546353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.546331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2496
2025-10-01T14:15:18.546362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.546397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:18.546420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529159:3461], now have 1 active actors on pipe
2025-10-01T14:15:18.546427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529071:2446], now have 1 active actors on pipe
2025-10-01T14:15:18.546441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.546450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.546467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.546473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.546475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.546489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:18.546499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:18.546505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:18.546507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:18.546508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:18.546521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:18.546528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:18.546542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:18.546553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.546561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.546563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:18.546571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.546585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:18.546619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.546632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:18.546636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:18.546646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.546728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2496
2025-10-01T14:15:18.546756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.546765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.546786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.546839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2497 partition: 0 MaxSeqNo: 45 sessionId: src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0
2025-10-01T14:15:18.547553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|598e0f3c-cc75a522-4f69c197-f02276c6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:18.550250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Write session: try to update token
2025-10-01T14:15:18.550265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:18.563106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId: src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:18.565292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:18.566258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.566278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.566295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:18.566298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.566300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:18.566301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:18.566307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.566311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.566313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256731443608835:7792]
2025-10-01T14:15:18.566349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:18.566355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:18.566358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:18.566359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.566362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:18.566363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:18.566503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:18.631953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256733820529171:5192]
2025-10-01T14:15:18.632146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2496, pipe: [1:7556256733820529171:5192]
2025-10-01T14:15:18.700234Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:18.700485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:18.700530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529171:5192], now have 1 active actors on pipe
2025-10-01T14:15:18.700620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:18.700701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256733820529171:5192]
2025-10-01T14:15:18.700709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:18.700712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:18.700724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:18.700777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2497 reason: error at write: Disconnected sessionId: src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0
2025-10-01T14:15:18.700956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2497 sessionId: src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0 is DEAD
2025-10-01T14:15:18.701079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:18.701088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Write session will restart in 0.008336s
2025-10-01T14:15:18.701105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Write session: Do CDS request
2025-10-01T14:15:18.701109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:18.707258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:18.708600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:18.708736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:18.708743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:18.708751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:18.708777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:18.708806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256731443608965:7769]
2025-10-01T14:15:18.709235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:18.709443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:18.709469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:18.709655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:18.709689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.709693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.709694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.709694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.709695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.709698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.709698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.709699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.709699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.709700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.709701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.709701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.709702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.709702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.709705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.709710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.709712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.709714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.709716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.709718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.709720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.709722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.709724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.709726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.709728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.709730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.709731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.709733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.709738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.709742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.709746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.709749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.709751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.709754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.709756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.709759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.709762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.709765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.709767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.709770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.709772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.709780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.709783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.709786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.709788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.709791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.709796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.709798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.709801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.709803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.709808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.709811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.709813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.709817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.709819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.709821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.709841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:18.710817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.710891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:18.710916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2498
2025-10-01T14:15:18.711055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.711087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:18.711097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:18.711101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:18.711415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2498 sessionId:  describe result for acl check
2025-10-01T14:15:18.711448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:18.711456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:18.711458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:18.711463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256733820529224:3437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:18.712131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256733820529224:3437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:18.713213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:18.713874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:18.713885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:18.713887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:18.713889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:18.713895Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2497 [2:7556256731443608965:7769]
2025-10-01T14:15:18.713906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:18.713919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:18.713924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.713926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.713927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.713938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:18.713943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:18.713947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:18.713940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256733820529224:3437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:18.713990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.713997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.713999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.714001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:18.714003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:18.714062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:18.714069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.714079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.714087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.714103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:18.714125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529173:2446], now have 1 active actors on pipe
2025-10-01T14:15:18.714112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2497
2025-10-01T14:15:18.714135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.714138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.714140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.714148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:18.714155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:18.714157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:18.714159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:18.714161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:18.714174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:18.714183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:18.714223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.714234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:18.714247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:18.718039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256733820529224:3437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:18.718052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256733820529224:3437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:18.718055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256733820529224:3437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:18.718063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:18.718254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529263:3437], now have 1 active actors on pipe
2025-10-01T14:15:18.718289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2497
2025-10-01T14:15:18.718337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.718347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.718366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:18.718392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.718397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.718399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:18.718410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.718422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:18.718440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.718562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.718568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.718577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.718628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2498 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0
2025-10-01T14:15:18.718949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8ce854-39de8971-d4d9fcfd-397aa108_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:18.721577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Write session: try to update token
2025-10-01T14:15:18.721590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:18.724209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:18.724222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.724231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.724257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:18.724268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:18.724415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:18.724549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:18.724668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:18.724804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:18.724984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:18.725015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:18.737346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId: src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:18.739797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:18.740088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.740107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.740145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:18.740190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:18.741925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:18.741937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.741939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:18.741942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:18.741949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.741953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.741955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256731443608960:7769]
2025-10-01T14:15:18.741994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:18.741996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:18.742001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:18.742001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.742004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:18.742005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:18.742128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:18.800926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256733820529267:5192]
2025-10-01T14:15:18.801139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2497, pipe: [1:7556256733820529267:5192]
2025-10-01T14:15:18.881121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:18.887896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.887921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.888056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.888110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.888163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.888217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.888256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.888263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.888321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.888376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.888432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.888489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.888547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.888555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.888617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.888677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.888735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.888795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.888834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.888840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.888899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.888955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.889011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.889083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.889138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.889144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.889211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.889264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.889318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.889372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.889409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.889414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.889473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.889529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.889585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.889643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.889682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.889687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.889745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.889797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.889854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.889909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.889949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.889954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.890022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.890082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.890144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.890203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.890248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.890253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.890316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.890392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.890466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.890540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.890589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.890599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.890679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:18.890747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:18.890819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:18.890884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:18.890928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:18.890936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:18.890984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529267:5192], now have 1 active actors on pipe
2025-10-01T14:15:18.891245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256733820529267:5192]
2025-10-01T14:15:18.891250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:18.891253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:18.891280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2498 reason: error at write: Disconnected sessionId: src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0
2025-10-01T14:15:18.891470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2498 sessionId: src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0 is DEAD
2025-10-01T14:15:18.891596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:18.891557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:18.891608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Write session will restart in 0.008967s
2025-10-01T14:15:18.891654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Write session: Do CDS request
2025-10-01T14:15:18.891661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:18.891992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:18.898681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:18.900428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:18.900630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:18.900642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:18.900653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:18.900701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:18.900743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256731443609056:7762]
2025-10-01T14:15:18.901288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:18.901568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:18.901611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:18.901866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.901898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:18.901928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:18.901956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.901940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2499
2025-10-01T14:15:18.901963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.901964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.901965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.901966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.901967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.901968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.901969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.901970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.901971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.901972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.901973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.901974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.901975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.901980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.901988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.901992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.901995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.901998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.902002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.902005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.902008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.902011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.902015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.902020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.902023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.902026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.902029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.902035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.902042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:18.902048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.902052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:18.902056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.902060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:18.902064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.902058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:18.902087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:18.902074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:18.902092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:18.902096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:18.902082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.902087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:18.902090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.902095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:18.902099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.902103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:18.902106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.902112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:18.902118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.902122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:18.902126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.902131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.902134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.902138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.902143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.902147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.902151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.902156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:18.902159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.902165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:18.902199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:18.902552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2499 sessionId:  describe result for acl check
2025-10-01T14:15:18.902579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:18.902583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:18.902584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:18.902589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256733820529319:3422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:18.902979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256733820529319:3422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:18.905259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256733820529319:3422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:18.905731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:18.906411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:18.906424Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:18.906427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:18.906429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:18.906436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2498 [2:7556256731443609056:7762]
2025-10-01T14:15:18.906452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:18.906470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:18.906477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.906480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.906482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.906498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:18.906503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:18.906509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:18.906560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.906566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.906568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.906571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:18.906573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:18.906636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:18.906644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.906654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:18.906662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:18.906678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:18.906698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529269:2446], now have 1 active actors on pipe
2025-10-01T14:15:18.906710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.906716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.906718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.906729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:18.906737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:18.906740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:18.906741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:18.906745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:18.906748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2498
2025-10-01T14:15:18.906757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:18.906766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:18.906795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.906804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:18.906808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:18.911561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256733820529319:3422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:18.911573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256733820529319:3422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:18.911577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256733820529319:3422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:18.911589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:18.911812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529357:3422], now have 1 active actors on pipe
2025-10-01T14:15:18.911837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2498
2025-10-01T14:15:18.911889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.911899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.911924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3413621e-2f3f26-47c7ea71-bab71b75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:18.911937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:18.911946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:18.911950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:18.911961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:18.911975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:18.911995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.912103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:18.912110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:18.912122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:18.912175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2499 partition: 0 MaxSeqNo: 45 sessionId: src_id|3413621e-2f3f26-47c7ea71-bab71b75_0
2025-10-01T14:15:18.912473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af158e-9c5a689c-1fce7020-7d679c7e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3413621e-2f3f26-47c7ea71-bab71b75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:18.915270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Write session: try to update token
2025-10-01T14:15:18.915287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:18.926768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:18.926785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:18.926788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:18.926790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:18.926802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.926810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.926815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256731443609050:7762]
2025-10-01T14:15:18.926862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:18.926868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:18.926875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:18.926876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:18.926877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:18.926880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:18.927024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:18.927918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId: src_id|3413621e-2f3f26-47c7ea71-bab71b75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:18.930437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:18.991408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256733820529361:5192]
2025-10-01T14:15:18.991651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2498, pipe: [1:7556256733820529361:5192]
2025-10-01T14:15:19.073621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:19.074015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.074030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.074069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256733820529361:5192], now have 1 active actors on pipe
2025-10-01T14:15:19.074256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256733820529361:5192]
2025-10-01T14:15:19.074270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:19.074263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:19.074283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:19.074285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:19.074334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2499 reason: error at write: Disconnected sessionId: src_id|3413621e-2f3f26-47c7ea71-bab71b75_0
2025-10-01T14:15:19.074495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2499 sessionId: src_id|3413621e-2f3f26-47c7ea71-bab71b75_0 is DEAD
2025-10-01T14:15:19.074639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:19.074650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Write session will restart in 0.006371s
2025-10-01T14:15:19.074676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Write session: Do CDS request
2025-10-01T14:15:19.074682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:19.081917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.082001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:19.082024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2500
2025-10-01T14:15:19.082149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.082133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:19.082182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:19.082192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:19.082196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:19.082704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2500 sessionId:  describe result for acl check
2025-10-01T14:15:19.082735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:19.082737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:19.082738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:19.082743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256738115496720:3412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:19.083213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256738115496720:3412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:19.083335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:19.083502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:19.083510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:19.083521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:19.083566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:19.083604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256735738576437:7766]
2025-10-01T14:15:19.083992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:19.084237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:19.084267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:19.084529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:19.084592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.084597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.084598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.084599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.084600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.084601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.084602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.084604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.084605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.084606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.084608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.084609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.084610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.084611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.084615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.084624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.084630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.084633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.084637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.084640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.084644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.084647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.084650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.084653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.084656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.084658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.084662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.084665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.084671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.084677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.084682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.084686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.084690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.084695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.084698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.084703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.084707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.084711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.084718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.084723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.084731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.084736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.084745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.084749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.084753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.084758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.084762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.084768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.084776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.084781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.084788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.084792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.084800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.084804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.084813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.084815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.084835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:19.085357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256738115496720:3412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:19.087934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256738115496720:3412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:19.087954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256738115496720:3412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:19.087958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256738115496720:3412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:19.087965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:19.088225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:19.088861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:19.088873Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:19.088875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:19.088878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:19.088886Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2499 [2:7556256735738576437:7766]
2025-10-01T14:15:19.088900Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:19.088919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:19.088926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.088929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.088931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.088945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:19.088955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:19.088964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:19.089017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.089023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.089024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.089027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:19.089029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:19.089089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:19.089098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.089108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.089120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.089136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:19.089157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496761:3412], now have 1 active actors on pipe
2025-10-01T14:15:19.089164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496673:2446], now have 1 active actors on pipe
2025-10-01T14:15:19.089172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.089177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.089179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.089164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2499
2025-10-01T14:15:19.089188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:19.089197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:19.089199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:19.089200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:19.089203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:19.089212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:19.089215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:19.089218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2499
2025-10-01T14:15:19.089250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.089262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:19.089270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:19.089274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.089279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.089317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:19.089327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.089331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.089333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.089340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.089351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:19.089369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.089491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.089497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.089510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.089577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2500 partition: 0 MaxSeqNo: 45 sessionId: src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0
2025-10-01T14:15:19.089877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3413621e-2f3f26-47c7ea71-bab71b75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:19.092632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Write session: try to update token
2025-10-01T14:15:19.092650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:19.108301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId: src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:19.109163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:19.109181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:19.109184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:19.109186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:19.109194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.109199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.109203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256735738576432:7766]
2025-10-01T14:15:19.109247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:19.109250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:19.109258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:19.109260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.109262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:19.109263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:19.109387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:19.110714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:19.174198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256738115496768:5192]
2025-10-01T14:15:19.174643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2499, pipe: [1:7556256738115496768:5192]
2025-10-01T14:15:19.252359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:19.252630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.252644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.252682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496768:5192], now have 1 active actors on pipe
2025-10-01T14:15:19.252821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:19.252860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:19.252865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:19.252873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:19.252924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256738115496768:5192]
2025-10-01T14:15:19.252932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2500 reason: error at write: Disconnected sessionId: src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0
2025-10-01T14:15:19.253098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2500 sessionId: src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0 is DEAD
2025-10-01T14:15:19.253257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:19.253268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Write session will restart in 0.005822s
2025-10-01T14:15:19.253297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Write session: Do CDS request
2025-10-01T14:15:19.253313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:19.259832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.259952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:19.259975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2501
2025-10-01T14:15:19.260101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.260134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:19.260148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:19.260151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:19.260530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2501 sessionId:  describe result for acl check
2025-10-01T14:15:19.260573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:19.260575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:19.260577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:19.260582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256738115496819:3399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:19.260761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:19.261083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256738115496819:3399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:19.262195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:19.262344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:19.262353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:19.262363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:19.262417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:19.262453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256735738576526:7756]
2025-10-01T14:15:19.263012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:19.263090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256738115496819:3399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:19.263300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:19.263340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:19.263638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:19.263696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.263703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.263704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.263705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.263705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.263706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.263707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.263709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.263710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.263711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.263712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.263713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.263714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.263715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.263720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.263729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.263732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.263738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.263742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.263746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.263749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.263752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.263756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.263759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.263762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.263765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.263768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.263771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.263777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.263784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.263790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.263794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.263797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.263802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.263806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.263811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.263821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.263826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.263833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.263837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.263841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.263846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.263850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.263859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.263864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.263873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.263878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.263884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.263889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.263893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.263900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.263905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.263909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.263916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.263920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.263929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.263964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:19.267237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256738115496819:3399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:19.267251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256738115496819:3399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:19.267255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256738115496819:3399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:19.267262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:19.267367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:19.267978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:19.267989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:19.267991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:19.267995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:19.268001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2500 [2:7556256735738576526:7756]
2025-10-01T14:15:19.268017Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:19.268035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:19.268041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.268044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.268046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.268059Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:19.268068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:19.268077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:19.268127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.268133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.268134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.268136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:19.268138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:19.268191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:19.268202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.268210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.268215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.268224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:19.268236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496859:3399], now have 1 active actors on pipe
2025-10-01T14:15:19.268239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496770:2446], now have 1 active actors on pipe
2025-10-01T14:15:19.268243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.268245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.268246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.268259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:19.268271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:19.268273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:19.268275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:19.268277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:19.268280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:19.268282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:19.268298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.268305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:19.268306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:19.268301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2500
2025-10-01T14:15:19.268332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.268341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.268320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2500
2025-10-01T14:15:19.268368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3257281-80460569-9f71c521-fcac9a8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:19.268379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.268383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.268389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.268395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.268400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:19.268412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.268519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.268524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.268543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.268617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2501 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3257281-80460569-9f71c521-fcac9a8f_0
2025-10-01T14:15:19.268960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa2064a-e1affbe1-328c0a7c-fae10d0e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3257281-80460569-9f71c521-fcac9a8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:19.271753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Write session: try to update token
2025-10-01T14:15:19.271773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:19.285075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId: src_id|e3257281-80460569-9f71c521-fcac9a8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:19.287503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:19.287978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.287999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.288023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:19.288027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:19.288029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:19.288031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:19.288039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.288043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.288048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256735738576521:7756]
2025-10-01T14:15:19.288088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:19.288100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:19.288103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:19.288103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:19.288109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.288112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:19.288230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:19.352894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256738115496888:5192]
2025-10-01T14:15:19.353135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2500, pipe: [1:7556256738115496888:5192]
2025-10-01T14:15:19.427409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:19.427730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:19.427775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496888:5192], now have 1 active actors on pipe
2025-10-01T14:15:19.427858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:19.427913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:19.427954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256738115496888:5192]
2025-10-01T14:15:19.427961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:19.427965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:19.427968Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:15:19.428034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2501 reason: error at write: Disconnected sessionId: src_id|e3257281-80460569-9f71c521-fcac9a8f_0
2025-10-01T14:15:19.428076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2501 sessionId: src_id|e3257281-80460569-9f71c521-fcac9a8f_0 is DEAD
2025-10-01T14:15:19.428143Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 25 consumer shared/user session shared/user_1_25_6015796456480817416_v1 is DEAD
2025-10-01T14:15:19.428269Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:15:19.428303Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256652216120353:5210] disconnected; active server actors: 1
2025-10-01T14:15:19.428315Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256652216120353:5210] client user disconnected session shared/user_1_25_6015796456480817416_v1
2025-10-01T14:15:19.428342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:19.428347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Write session will restart in 0.007566s
2025-10-01T14:15:19.428366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Write session: Do CDS request
2025-10-01T14:15:19.428373Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:15:19.428376Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:15:19.428370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:19.428382Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.007651s
2025-10-01T14:15:19.433851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:19.435060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:19.435222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:19.435231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:19.435242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:19.435284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:19.435316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256735738576621:7751]
2025-10-01T14:15:19.435831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:19.436035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:19.436072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:19.436353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:19.436406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.436411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.436412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.436414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.436415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.436416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.436417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.436418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.436419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.436420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.436421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.436424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.436425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.436426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.436431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.436440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.436444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.436447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.436451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.436455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.436460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.436466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.436469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.436475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.436477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.436478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.436480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.436482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.436486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.436496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.436505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.436514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.436518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.436523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.436526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.436531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.436546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.436555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.436559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.436569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.436577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.436585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.436593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.436601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.436609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.436613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.436621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.436625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.436633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.436638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.436645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.436649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.436654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.436661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.436665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.436669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.436704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:19.436723Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:15:19.436852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.436898Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:15:19.436898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:19.436909Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 26
2025-10-01T14:15:19.436913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2502
2025-10-01T14:15:19.436997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.437017Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 26 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:15:19.437021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:19.437025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:19.437028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:19.437049Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:15:19.437112Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 auth for : user
2025-10-01T14:15:19.437203Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 Handle describe topics response
2025-10-01T14:15:19.437218Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 auth is DEAD
2025-10-01T14:15:19.437231Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:15:19.437372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2502 sessionId:  describe result for acl check
2025-10-01T14:15:19.437392Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:15:19.437393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:19.437394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:19.437395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:19.437398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256738115496948:3363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:19.437465Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_26_15928283803113236713_v1
2025-10-01T14:15:19.437463Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256738115496949:3361] connected; active server actors: 1
2025-10-01T14:15:19.437473Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256738115496949:3361] session shared/user_1_26_15928283803113236713_v1
2025-10-01T14:15:19.437480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:15:19.437491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:15:19.437498Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_26_15928283803113236713_v1" (Sender=[1:7556256738115496943:3361], Pipe=[1:7556256738115496949:3361], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:15:19.437501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:15:19.437509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:15:19.437519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_26_15928283803113236713_v1" (Sender=[1:7556256738115496943:3361], Pipe=[1:7556256738115496949:3361], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:15:19.437531Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_26_15928283803113236713_v1" sender [1:7556256738115496943:3361] lock partition 0 for ReadingSession "shared/user_1_26_15928283803113236713_v1" (Sender=[1:7556256738115496943:3361], Pipe=[1:7556256738115496949:3361], Partitions=[], ActiveFamilyCount=1) generation 1 step 26
2025-10-01T14:15:19.437539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:15:19.437543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-10-01T14:15:19.437658Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 26 Session: "shared/user_1_26_15928283803113236713_v1" ClientId: "user" PipeClient { RawX1: 7556256738115496949 RawX2: 4503603922341153 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:15:19.437671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:15:19.437874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256738115496948:3363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:19.439446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256738115496948:3363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:19.440113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:19.440725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:19.440737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:19.440739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:19.440742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:19.440748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2501 [2:7556256735738576621:7751]
2025-10-01T14:15:19.440764Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:19.440781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:19.440787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.440791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.440793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.440809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:19.440818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:19.440828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:19.440880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.440885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.440887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.440890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:19.440893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:19.440951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:19.440958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.440968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.440979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.440995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:19.441015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496952:3353], now have 1 active actors on pipe
2025-10-01T14:15:19.441022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496890:2446], now have 1 active actors on pipe
2025-10-01T14:15:19.441029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.441032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.441034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.441045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:19.441033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2501
2025-10-01T14:15:19.441033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2501, pipe: [1:7556256738115496952:3353]
2025-10-01T14:15:19.441056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:19.441056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:19.441059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:19.441061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:19.441072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:19.441075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:19.441113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.441122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.441133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_26_15928283803113236713_v1 on pipe: [1:7556256738115496952:3353]
2025-10-01T14:15:19.441153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.441162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:19.441173Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_26_15928283803113236713_v1:1 with generation 2501
2025-10-01T14:15:19.441180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.441181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:19.441185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.441188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.441201Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_26_15928283803113236713_v1
2025-10-01T14:15:19.441208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.441233Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:15:19.443304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:15:19.443327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:15:19.443332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.443334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.443336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.443341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:15:19.443349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:15:19.443465Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328119440 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:15:19.443480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:15:19.443507Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 sending to client partition status
2025-10-01T14:15:19.444434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256738115496948:3363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:19.444444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256738115496948:3363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:19.444447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256738115496948:3363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:19.444451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:19.444631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115496992:3363], now have 1 active actors on pipe
2025-10-01T14:15:19.444658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2501
2025-10-01T14:15:19.444715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.444723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.444744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:19.444755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.444759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.444764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.444773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.444785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:19.444797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.444903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.444911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.444922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.444977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2502 partition: 0 MaxSeqNo: 45 sessionId: src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0
2025-10-01T14:15:19.445184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3257281-80460569-9f71c521-fcac9a8f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:19.447906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Write session: try to update token
2025-10-01T14:15:19.447923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:19.460493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:19.460512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:19.460515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:19.460516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:19.460527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.460544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.460548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256735738576616:7751]
2025-10-01T14:15:19.460591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:19.460595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:19.460599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:19.460602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.460602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:19.460604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:19.460594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId: src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:19.460754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:19.462888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:19.599259Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:19.599677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.599693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.599896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256738115496952:3353]
2025-10-01T14:15:19.599911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:19.599914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:19.599920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_26_15928283803113236713_v1
2025-10-01T14:15:19.599941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:19.599936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:19.599969Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_26_15928283803113236713_v1
2025-10-01T14:15:19.599985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2502 reason: error at write: Disconnected sessionId: src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0
2025-10-01T14:15:19.600151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2502 sessionId: src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0 is DEAD
2025-10-01T14:15:19.600295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:19.600306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Write session will restart in 0.009371s
2025-10-01T14:15:19.600324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Write session: Do CDS request
2025-10-01T14:15:19.600329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:19.606963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:19.608322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:19.608447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:19.608455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:19.608462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:19.608491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:19.608517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256735738576713:7748]
2025-10-01T14:15:19.608908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:19.609118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:19.609147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:19.609339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:19.609374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.609378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.609379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.609380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.609380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.609381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.609382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.609383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.609384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.609386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.609386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.609387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.609388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.609388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.609391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.609397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.609399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.609401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.609403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.609405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.609407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.609409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.609411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.609414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.609416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.609417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.609419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.609421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.609427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.609431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.609435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.609438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.609440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.609443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.609445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.609448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.609450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.609453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.609455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.609458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.609461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.609464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.609466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.609469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.609471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.609474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.609476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.609479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.609481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.609484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.609486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.609488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.609490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.609492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.609494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.609497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.609517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:19.610846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.610892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:19.610904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2503
2025-10-01T14:15:19.611069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.611092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:19.611100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:19.611102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:19.611453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2503 sessionId:  describe result for acl check
2025-10-01T14:15:19.611482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:19.611488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:19.611489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:19.611494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256738115497060:3341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:19.611951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256738115497060:3341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:19.612836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:19.613490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:19.613500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:19.613503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256738115497060:3341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:19.613501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:19.613503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:19.613508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2502 [2:7556256735738576713:7748]
2025-10-01T14:15:19.613518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:19.613532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:19.613534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.613537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.613539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.613553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:19.613558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:19.613566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:19.613607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.613612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.613613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.613615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:19.613617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:19.613661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:19.613665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.613672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.613677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.613686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:19.613697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.613701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.613702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.613708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:19.613716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:19.613716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497001:2446], now have 1 active actors on pipe
2025-10-01T14:15:19.613723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:19.613723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:19.613725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:19.613732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:19.613734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:19.613749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.613754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:19.613758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:19.613743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2502
2025-10-01T14:15:19.618501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256738115497060:3341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:19.618511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256738115497060:3341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:19.618515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256738115497060:3341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:19.618522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:19.618909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497100:3341], now have 1 active actors on pipe
2025-10-01T14:15:19.618961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2502
2025-10-01T14:15:19.619096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.619112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.619148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:19.619162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.619172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.619176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.619186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.619212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:19.619228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.619382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.619390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.619407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.619484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2503 partition: 0 MaxSeqNo: 45 sessionId: src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0
2025-10-01T14:15:19.619802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab9c70-2fdffd8a-fbd5e50c-37617539_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:19.622449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Write session: try to update token
2025-10-01T14:15:19.622462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:19.633054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:19.633067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:19.633069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:19.633071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:19.633078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.633081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.633084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256735738576708:7748]
2025-10-01T14:15:19.633113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:19.633118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:19.633119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:19.633124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.633126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:19.633128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:19.633239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:19.635139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId: src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:19.637487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:19.700005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256738115497104:3353]
2025-10-01T14:15:19.700163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2502, pipe: [1:7556256738115497104:3353]
2025-10-01T14:15:19.770448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:19.770880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.770894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.770933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497104:3353], now have 1 active actors on pipe
2025-10-01T14:15:19.771134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:19.771151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256738115497104:3353]
2025-10-01T14:15:19.771157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:19.771160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:19.771177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:19.771212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2503 reason: error at write: Disconnected sessionId: src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0
2025-10-01T14:15:19.771358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2503 sessionId: src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0 is DEAD
2025-10-01T14:15:19.771510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:19.771521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Write session will restart in 0.006088s
2025-10-01T14:15:19.771547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Write session: Do CDS request
2025-10-01T14:15:19.771553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:19.778751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.778822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:19.778835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2504
2025-10-01T14:15:19.778959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.778991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:19.778998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:19.779001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:19.779282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:19.779340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2504 sessionId:  describe result for acl check
2025-10-01T14:15:19.779367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:19.779374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:19.779375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:19.779379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256738115497157:3338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:19.779780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256738115497157:3338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:19.780935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:19.781075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:19.781083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:19.781094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:19.781125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:19.781158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256735738576844:7733]
2025-10-01T14:15:19.781553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:19.781571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256738115497157:3338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:19.781807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:19.781839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:19.782049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:19.782098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.782104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.782104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.782105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.782106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.782106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.782107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.782107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.782108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.782108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.782109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.782109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.782110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.782110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.782113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.782118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.782120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.782122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.782124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.782126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.782128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.782129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.782131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.782133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.782135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.782136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.782138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.782140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.782144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.782150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.782155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.782160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.782164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.782168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.782173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.782179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.782182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.782187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.782190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.782194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.782199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.782203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.782207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.782211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.782216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.782220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.782224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.782229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.782233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.782235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.782238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.782240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.782243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.782245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.782247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.782250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.782271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:19.785432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256738115497157:3338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:19.785443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256738115497157:3338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:19.785448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256738115497157:3338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:19.785453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:19.785653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:19.786361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:19.786405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:19.786412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:19.786415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:19.786421Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2503 [2:7556256735738576844:7733]
2025-10-01T14:15:19.786436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:19.786453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:19.786459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.786462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.786464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.786477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:19.786483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:19.786488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:19.786530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.786537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.786539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.786542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:19.786545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:19.786600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:19.786606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.786616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.786628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.786645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:19.786665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497198:3338], now have 1 active actors on pipe
2025-10-01T14:15:19.786672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497106:2446], now have 1 active actors on pipe
2025-10-01T14:15:19.786679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.786685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.786687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.786699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:19.786710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:19.786714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:19.786727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:19.786720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:19.786732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:19.786734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:19.786753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.786760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:19.786765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:19.786781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2503
2025-10-01T14:15:19.786783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2503
2025-10-01T14:15:19.786861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.786871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.786896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:19.786906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.786909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.786911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.786919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.786931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:19.786948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.787087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.787099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.787122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.787235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2504 partition: 0 MaxSeqNo: 45 sessionId: src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0
2025-10-01T14:15:19.787538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fccbb5a5-ad5d2cab-89ce759e-74c0f9b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:19.790035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Write session: try to update token
2025-10-01T14:15:19.790047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:19.803530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId: src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:19.805784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:19.806588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.806611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.806631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:19.806634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:19.806637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:19.806638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:19.806647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.806653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.806659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256735738576839:7733]
2025-10-01T14:15:19.806700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:19.806713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:19.806717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:19.806718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:19.806726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.806728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:19.806903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:19.871535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256738115497205:3353]
2025-10-01T14:15:19.871856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2503, pipe: [1:7556256738115497205:3353]
2025-10-01T14:15:19.948199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:19.948399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:19.948442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497205:3353], now have 1 active actors on pipe
2025-10-01T14:15:19.948520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:19.948560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:19.948595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256738115497205:3353]
2025-10-01T14:15:19.948603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:19.948605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:19.948657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2504 reason: error at write: Disconnected sessionId: src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0
2025-10-01T14:15:19.948772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2504 sessionId: src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0 is DEAD
2025-10-01T14:15:19.948877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:19.948892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Write session will restart in 0.009333s
2025-10-01T14:15:19.948908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Write session: Do CDS request
2025-10-01T14:15:19.948914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:19.955406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:19.956671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:19.956812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:19.956827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:19.956835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:19.956864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:19.956891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256735738576937:7726]
2025-10-01T14:15:19.957275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:19.957453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:19.957478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:19.957680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:19.957715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.957719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.957720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.957720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.957721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.957722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.957722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.957723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.957723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.957724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.957724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.957725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.957726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.957727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.957729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.957735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.957737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.957739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.957741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.957744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.957745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.957747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.957749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.957752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.957755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.957757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.957759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.957761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.957765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.957770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:19.957773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.957776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:19.957778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.957781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:19.957783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.957786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:19.957788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.957791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:19.957794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.957796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:19.957799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.957805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:19.957808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.957810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:19.957813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.957819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:19.957821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.957824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.957830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.957833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.957835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.957841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.957843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.957846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:19.957851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.957854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:19.957874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:19.958798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.958897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:19.958910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2505
2025-10-01T14:15:19.958988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:19.959010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:19.959017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:19.959035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:19.959284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2505 sessionId:  describe result for acl check
2025-10-01T14:15:19.959307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:19.959308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:19.959309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:19.959312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256738115497268:3307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:19.959680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256738115497268:3307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:19.961027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256738115497268:3307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:19.961120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:19.961787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:19.961796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:19.961797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:19.961799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:19.961804Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2504 [2:7556256735738576937:7726]
2025-10-01T14:15:19.961812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:19.961822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:19.961827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.961829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.961831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.961840Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:19.961846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:19.961850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:19.961886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.961891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.961893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.961895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:19.961897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:19.961940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:19.961945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.961951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:19.961956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:19.961966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:19.961982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497208:2446], now have 1 active actors on pipe
2025-10-01T14:15:19.961993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.962000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.962002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.962013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:19.962008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2504
2025-10-01T14:15:19.962024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:19.962026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:19.962029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:19.962030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:19.962035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:19.962037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:19.962058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.962067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:19.962089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:19.966335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256738115497268:3307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:19.966348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256738115497268:3307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:19.966350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256738115497268:3307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:19.966355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:19.966613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256738115497304:3307], now have 1 active actors on pipe
2025-10-01T14:15:19.966620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2504
2025-10-01T14:15:19.966680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.966690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.966718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:19.966732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:19.966740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:19.966746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:19.966759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:19.966776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:19.966796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.966956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:19.966966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:19.966984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:19.967039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2505 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0
2025-10-01T14:15:19.967373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5646348e-17d3ebec-6ce41b90-88de9b74_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:19.970034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Write session: try to update token
2025-10-01T14:15:19.970049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:19.981089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:19.981103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:19.981104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:19.981108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:19.981114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.981121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.981124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256735738576932:7726]
2025-10-01T14:15:19.981157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:19.981159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:19.981165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:19.981166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:19.981167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:19.981169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:19.981281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:19.982800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId: src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:19.984963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:20.048683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256742410464605:3353]
2025-10-01T14:15:20.048949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2504, pipe: [1:7556256742410464605:3353]
2025-10-01T14:15:20.127689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:20.127962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.127986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.128030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464605:3353], now have 1 active actors on pipe
2025-10-01T14:15:20.128212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:20.128218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256742410464605:3353]
2025-10-01T14:15:20.128232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:20.128236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:20.128247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:20.128284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2505 reason: error at write: Disconnected sessionId: src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0
2025-10-01T14:15:20.128416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2505 sessionId: src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0 is DEAD
2025-10-01T14:15:20.128551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:20.128561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Write session will restart in 0.007926s
2025-10-01T14:15:20.128580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Write session: Do CDS request
2025-10-01T14:15:20.128586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:20.135420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:20.136757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:20.136927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:20.136938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:20.136949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:20.136998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:20.137042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256740033544325:7723]
2025-10-01T14:15:20.137622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:20.137932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.137935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:20.137972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:20.137999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:20.137986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2506
2025-10-01T14:15:20.138196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.138238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:20.138244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:20.138248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:20.138359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:20.138444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.138449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.138450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.138451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.138452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.138453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.138455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.138456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.138459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.138460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.138461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.138462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.138463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.138464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.138469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.138477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.138481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.138484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.138488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.138491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.138494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.138497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.138501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.138504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.138509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.138512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.138516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.138519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.138526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.138533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.138539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.138544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.138549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.138553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.138558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.138562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.138566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.138571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.138578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.138584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.138590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.138599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.138603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.138607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.138611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.138618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.138622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.138628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.138633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.138640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.138643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.138628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2506 sessionId:  describe result for acl check
2025-10-01T14:15:20.138647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.138655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.138659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.138663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.138668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.138708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:20.138661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:20.138667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:20.138670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:20.138675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256742410464676:3290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:20.139196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256742410464676:3290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:20.140935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256742410464676:3290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:20.142247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:20.142992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:20.143007Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:20.143009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:20.143012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:20.143019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2505 [2:7556256740033544325:7723]
2025-10-01T14:15:20.143037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:20.143054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:20.143063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.143067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.143068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.143083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:20.143088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:20.143093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:20.143107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256742410464676:3290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:20.143117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256742410464676:3290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:20.143120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256742410464676:3290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:20.143126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:20.143139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.143143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.143144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.143146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:20.143148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:20.143208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:20.143215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.143225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.143237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.143257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:20.143280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464620:2446], now have 1 active actors on pipe
2025-10-01T14:15:20.143291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.143271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2505
2025-10-01T14:15:20.143292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.143293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.143299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:20.143308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:20.143314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:20.143317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:20.143319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:20.143320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:20.143322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:20.143359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.143369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:20.143375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:20.143377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464712:3290], now have 1 active actors on pipe
2025-10-01T14:15:20.143390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2505
2025-10-01T14:15:20.143467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.143477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.143496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fadd33e-6c2fd494-44248805-b566526b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:20.143502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.143510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.143511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:20.143518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.143528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:20.143540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.143718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.143725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.143737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.143846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2506 partition: 0 MaxSeqNo: 45 sessionId: src_id|2fadd33e-6c2fd494-44248805-b566526b_0
2025-10-01T14:15:20.144187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca7235c-bcfea6f-c21b4dc9-afc130b5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2fadd33e-6c2fd494-44248805-b566526b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:20.146796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Write session: try to update token
2025-10-01T14:15:20.146809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:20.159297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId: src_id|2fadd33e-6c2fd494-44248805-b566526b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:20.161721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:20.162350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.162391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.162412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:20.162415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.162417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:20.162419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:20.162428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.162433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.162437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256740033544320:7723]
2025-10-01T14:15:20.162485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:20.162492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:20.162496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:20.162498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.162499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:20.162502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:20.162628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:20.228402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256742410464720:3353]
2025-10-01T14:15:20.228645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2505, pipe: [1:7556256742410464720:3353]
2025-10-01T14:15:20.295013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:20.295260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:20.295305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464720:3353], now have 1 active actors on pipe
2025-10-01T14:15:20.295379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:20.295445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:20.295487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256742410464720:3353]
2025-10-01T14:15:20.302528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:20.303643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:20.303651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:20.303669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2506 reason: error at write: Disconnected sessionId: src_id|2fadd33e-6c2fd494-44248805-b566526b_0
2025-10-01T14:15:20.303767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2506 sessionId: src_id|2fadd33e-6c2fd494-44248805-b566526b_0 is DEAD
2025-10-01T14:15:20.303870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:20.303877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Write session will restart in 0.008486s
2025-10-01T14:15:20.303904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Write session: Do CDS request
2025-10-01T14:15:20.303909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:20.308562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:20.308905Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:20.308915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:20.308928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:20.308988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:20.309030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256740033544421:7709]
2025-10-01T14:15:20.309585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:20.309913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:20.309959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:20.310255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:20.310335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.310341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.310342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.310344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.310345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.310348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.310350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.310351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.310352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.310353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.310354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.310355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.310356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.310357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.310361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.310384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.310388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.310392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.310395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.310399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.310402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.310405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.310409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.310413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.310417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.310420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.310423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.310427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.310434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.310441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.310447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.310453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.310457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.310463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.310466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.310471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.310477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.310482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.310486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.310492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.310500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.310504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.310508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.310512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.310518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.310525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.310529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.310534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.310540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.310545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.310550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.310555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.310564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.310568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.310572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.310577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.310613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:20.313862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.313912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:20.313925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2507
2025-10-01T14:15:20.314058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.314082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:20.314086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:20.314089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:20.314291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:20.314495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2507 sessionId:  describe result for acl check
2025-10-01T14:15:20.314534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:20.314543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:20.314546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:20.314552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256742410464783:3281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:20.315022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:20.315040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:20.315043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:20.315046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:20.315053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2506 [2:7556256740033544421:7709]
2025-10-01T14:15:20.315070Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:20.315089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:20.315097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.315100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.315103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.315097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256742410464783:3281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:20.315116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:20.315125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:20.315131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:20.315184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.315190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.315192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.315196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:20.315198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:20.315261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:20.315267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.315278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.315293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.315312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:20.315334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464722:2446], now have 1 active actors on pipe
2025-10-01T14:15:20.315346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.315351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.315353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.315366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:20.315374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:20.315376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:20.315377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:20.315378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:20.315367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2506
2025-10-01T14:15:20.315392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:20.315402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:20.315434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.315446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:20.315459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:20.317451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256742410464783:3281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:20.322120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256742410464783:3281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:20.322132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256742410464783:3281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:20.322134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256742410464783:3281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:20.322140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:20.322317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464821:3281], now have 1 active actors on pipe
2025-10-01T14:15:20.322354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2506
2025-10-01T14:15:20.322399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.322413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.322441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:20.322455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.322465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.322471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:20.322481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.322498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:20.322519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.322633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.322639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.322653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.322714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2507 partition: 0 MaxSeqNo: 45 sessionId: src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0
2025-10-01T14:15:20.323059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fadd33e-6c2fd494-44248805-b566526b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:20.325668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Write session: try to update token
2025-10-01T14:15:20.325681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:20.334663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:20.334677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.334680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:20.334682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:20.334691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.334696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.334700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256740033544415:7709]
2025-10-01T14:15:20.334746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:20.334745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:20.334751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:20.334753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:20.334754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.334756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:20.334883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:20.340818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId: src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:20.343398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:20.395798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256742410464846:3353]
2025-10-01T14:15:20.396006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2506, pipe: [1:7556256742410464846:3353]
2025-10-01T14:15:20.470346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:20.470755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.470768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.470790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464846:3353], now have 1 active actors on pipe
2025-10-01T14:15:20.470948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:20.471029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256742410464846:3353]
2025-10-01T14:15:20.471043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:20.471056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:20.471110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2507 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0
2025-10-01T14:15:20.471266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2507 sessionId: src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0 is DEAD
2025-10-01T14:15:20.471434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:20.471445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Write session will restart in 0.008045s
2025-10-01T14:15:20.471469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Write session: Do CDS request
2025-10-01T14:15:20.471475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:20.478127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:20.479494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:20.479670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:20.479682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:20.479693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:20.479733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:20.479767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256740033544521:7715]
2025-10-01T14:15:20.480125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:20.480320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:20.480343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:20.480520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:20.480563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.480567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.480568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.480568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.480569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.480569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.480570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.480570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.480571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.480572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.480572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.480573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.480573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.480574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.480577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.480584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.480586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.480588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.480590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.480592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.480593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.480595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.480597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.480599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.480602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.480604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.480606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.480608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.480613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.480617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.480621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.480624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.480626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.480629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.480632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.480634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.480637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.480639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.480642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.480644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.480647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.480650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.480652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.480655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.480657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.480659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.480662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.480665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.480667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.480670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.480672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.480674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.480676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.480679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.480680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.480683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.480703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:20.480845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.480907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:20.480917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2508
2025-10-01T14:15:20.481030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.481050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:20.481057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:20.481059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:20.481355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2508 sessionId:  describe result for acl check
2025-10-01T14:15:20.481387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:20.481391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:20.481392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:20.481395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256742410464908:3246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:20.481758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256742410464908:3246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:20.483638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256742410464908:3246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:20.483911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:20.484483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:20.484494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:20.484495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:20.484498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:20.484502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2507 [2:7556256740033544521:7715]
2025-10-01T14:15:20.484514Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:20.484527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:20.484543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.484546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.484548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.484561Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:20.484570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:20.484579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:20.484621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.484625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.484626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.484628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:20.484629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:20.484670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:20.484675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.484682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.484687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.484696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:20.484711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464848:2446], now have 1 active actors on pipe
2025-10-01T14:15:20.484719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.484720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.484722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.484729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:20.484740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:20.484740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:20.484743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:20.484745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:20.484750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:20.484752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:20.484770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.484777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:20.484783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:20.484871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2507
2025-10-01T14:15:20.489508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256742410464908:3246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:20.489521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256742410464908:3246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:20.489524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256742410464908:3246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:20.489530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:20.489688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464947:3246], now have 1 active actors on pipe
2025-10-01T14:15:20.489723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2507
2025-10-01T14:15:20.489781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.489789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.489807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:20.489816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.489847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.489851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:20.489858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.489871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:20.489884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.490005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.490012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.490023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.490101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2508 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0
2025-10-01T14:15:20.490434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2df092b-32ba3968-59733adb-a4ff3cc7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:20.493107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Write session: try to update token
2025-10-01T14:15:20.493124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:20.503342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:20.503357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.503365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.503406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:20.503413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:20.503567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:20.503706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:20.503846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:20.503981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:20.504166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:20.504197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:20.507742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId: src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:20.510004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:20.510198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.510221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.510259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:20.510330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:20.513487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:20.513507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.513510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:20.513512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:20.513523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.513527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.513531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256740033544516:7715]
2025-10-01T14:15:20.513577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:20.513585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:20.513591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.513591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:20.513594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:20.513595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:20.513721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:20.571449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256742410464953:3353]
2025-10-01T14:15:20.571713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2507, pipe: [1:7556256742410464953:3353]
2025-10-01T14:15:20.645805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:20.652037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.652057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.652176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.652223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.652274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.652318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.652506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.652514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.652580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.652627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.652671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.652718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.652755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.652762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.652817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.652868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.652917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.652966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.653003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.653007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.653061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.653115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.653167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.653218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.653346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.653353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.653407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.653453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.653502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.653550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.653586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.653590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.653642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.653691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.653741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.653790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.653831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.653838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.653904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.653971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.654027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.654074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.654151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.654156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.654219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.654275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.654341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.654414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.654455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.654460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.654518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.654567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.654617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.654669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.654709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.654711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.654775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.654837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.654896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.654958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.655006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.655013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.655057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464953:3353], now have 1 active actors on pipe
2025-10-01T14:15:20.655245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:20.655282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256742410464953:3353]
2025-10-01T14:15:20.655294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:20.655297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:20.655325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2508 reason: error at write: Disconnected sessionId: src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0
2025-10-01T14:15:20.655526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2508 sessionId: src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0 is DEAD
2025-10-01T14:15:20.655634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:20.655645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Write session will restart in 0.009780s
2025-10-01T14:15:20.655669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Write session: Do CDS request
2025-10-01T14:15:20.655674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:20.655754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:20.663200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:20.664741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:20.664878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:20.664886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:20.664893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:20.664925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:20.664964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256740033544628:7714]
2025-10-01T14:15:20.665464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:20.665715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:20.665758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:20.666031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:20.666093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.666100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.666100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.666101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.666102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.666103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.666105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.666106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.666107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.666108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.666109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.666110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.666111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.666112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.666116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.666125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.666129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.666132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.666136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.666139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.666143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.666146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.666150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.666154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.666157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.666160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.666163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.666166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.666174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.666181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.666187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.666192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.666195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.666201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.666205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.666209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.666214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.666219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.666222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.666232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.666237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.666246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.666250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.666254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.666258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.666264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.666268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.666272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.666276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.666280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.666285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.666293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.666297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.666303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.666307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.666311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.666350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:20.666809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.666867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:20.666879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2509
2025-10-01T14:15:20.666982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.667010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:20.667019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:20.667022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:20.667368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2509 sessionId:  describe result for acl check
2025-10-01T14:15:20.667402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:20.667408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:20.667410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:20.667414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256742410465023:3222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:20.667887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256742410465023:3222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:20.669724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:20.670052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256742410465023:3222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:20.670468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:20.670479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:20.670482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:20.670485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:20.670491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2508 [2:7556256740033544628:7714]
2025-10-01T14:15:20.670503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:20.670516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:20.670519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.670521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.670524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.670539Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:20.670547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:20.670555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:20.670598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.670607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.670609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.670612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:20.670615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:20.670685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:20.670693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.670703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.670714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.670729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:20.670744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410464961:2446], now have 1 active actors on pipe
2025-10-01T14:15:20.670753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.670754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.670756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.670764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:20.670779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:20.670784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:20.670787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:20.670789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:20.670796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:20.670799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:20.670815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.670824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:20.670843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:20.670907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2508
2025-10-01T14:15:20.675154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256742410465023:3222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:20.675167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256742410465023:3222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:20.675170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256742410465023:3222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:20.675178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:20.675375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410465061:3222], now have 1 active actors on pipe
2025-10-01T14:15:20.675414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2508
2025-10-01T14:15:20.675466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.675477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.675496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e5747c2-b31d2962-44328833-30e27fa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:20.675506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.675513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.675515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:20.675524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.675536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:20.675550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.675661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.675670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.675692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.675751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2509 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e5747c2-b31d2962-44328833-30e27fa2_0
2025-10-01T14:15:20.676049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f11f3e1-595be553-f26ed465-5d70e4c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e5747c2-b31d2962-44328833-30e27fa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:20.679054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Write session: try to update token
2025-10-01T14:15:20.679072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:20.681144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:20.681157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.681165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.681206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:20.681207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:20.681392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:20.681550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:20.681692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:20.681823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:20.682005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:20.682037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:20.693014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId: src_id|2e5747c2-b31d2962-44328833-30e27fa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:20.695402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:20.695606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.695628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.695661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:20.695743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:20.698814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:20.698829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.698832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:20.698833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:20.698843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.698847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.698854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256740033544623:7714]
2025-10-01T14:15:20.698894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:20.698896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:20.698902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.698903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:20.698906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:20.698910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:20.699028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:20.755213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256742410465064:3353]
2025-10-01T14:15:20.755431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2508, pipe: [1:7556256742410465064:3353]
2025-10-01T14:15:20.779269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:15:20.779290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-01T14:15:20.839380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:20.847670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.847690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.847965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.848022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.848074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.848128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.848451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.848463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.848519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.848585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.848637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.848692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.848732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.848738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.848797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.848857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.848911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.849098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.849136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.849141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.849208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.849276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.849335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.849393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.849432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.849437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.849498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.849548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.849599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.849649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.849687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.849692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.849745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.849798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.849856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.849910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.849948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.849955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.850015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.850065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.850121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.850176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.850213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.850220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.850287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.850350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.850438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.850511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.850648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.850655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.850714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.850766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.850816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.850875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.850914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.850919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.850974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:20.851034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:20.851095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:20.851159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:20.851203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:20.851210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:20.851269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410465064:3353], now have 1 active actors on pipe
2025-10-01T14:15:20.851541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256742410465064:3353]
2025-10-01T14:15:20.851573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:20.851584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-01T14:15:20.851583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:20.851587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:20.851617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2509 reason: error at write: Disconnected sessionId: src_id|2e5747c2-b31d2962-44328833-30e27fa2_0
2025-10-01T14:15:20.851792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2509 sessionId: src_id|2e5747c2-b31d2962-44328833-30e27fa2_0 is DEAD
2025-10-01T14:15:20.851986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:20.851999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Write session will restart in 0.009799s
2025-10-01T14:15:20.852039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Write session: Do CDS request
2025-10-01T14:15:20.852045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:20.852136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:20.858986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:20.860222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:20.860383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:20.860392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:20.860402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:20.860441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:20.860483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256740033544756:7691]
2025-10-01T14:15:20.861042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:20.861243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:20.861271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:20.861455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:20.861497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.861502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.861503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.861503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.861504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.861504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.861505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.861505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.861506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.861506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.861507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.861508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.861508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.861509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.861512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.861518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.861520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.861522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.861524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.861526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.861528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.861530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.861532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.861536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.861538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.861540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.861542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.861543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.861548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.861553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:20.861556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.861558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:20.861561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.861563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:20.861566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.861568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:20.861571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.861573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:20.861575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.861578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:20.861580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.861583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:20.861585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.861587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:20.861590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.861593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:20.861595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.861598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.861600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.861604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.861606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.861609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.861612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.861615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:20.861618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.861624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:20.861645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:20.862773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.862804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:20.862814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2510
2025-10-01T14:15:20.862945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:20.862966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:20.862973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:20.862976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:20.863343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2510 sessionId:  describe result for acl check
2025-10-01T14:15:20.863371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:20.863377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:20.863378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:20.863382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256742410465133:3216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:20.863848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256742410465133:3216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:20.864936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:20.865561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:20.865568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256742410465133:3216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:20.865573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:20.865574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:20.865576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:20.865581Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2509 [2:7556256740033544756:7691]
2025-10-01T14:15:20.865588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:20.865599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:20.865600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.865602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.865604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.865614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:20.865617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:20.865621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:20.865661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.865669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.865671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.865673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:20.865675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:20.865737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:20.865744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.865755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:20.865765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:20.865777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:20.865792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410465070:2446], now have 1 active actors on pipe
2025-10-01T14:15:20.865788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2509
2025-10-01T14:15:20.865800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.865801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.865802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.865809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:20.865817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:20.865819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:20.865820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:20.865823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:20.865835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:20.865842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:20.865879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.865890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:20.865896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:20.865922Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:15:20.866072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 22 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:15:20.866098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:15:20.869720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256742410465133:3216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:20.869732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256742410465133:3216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:20.869735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256742410465133:3216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:20.869742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:20.869954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410465174:3216], now have 1 active actors on pipe
2025-10-01T14:15:20.869993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2509
2025-10-01T14:15:20.870051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.870061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.870085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:20.870095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:20.870099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:20.870105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:20.870112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:20.870125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:20.870144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.870288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:20.870295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:20.870309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:20.870388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2510 partition: 0 MaxSeqNo: 45 sessionId: src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0
2025-10-01T14:15:20.870673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5747c2-b31d2962-44328833-30e27fa2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:20.884993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:20.885010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:20.885012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:20.885014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:20.885024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.885028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.885031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256740033544751:7691]
2025-10-01T14:15:20.885065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:20.885071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:20.885073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:20.885074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:20.885082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:20.885086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:20.885210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:20.888714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Write session: try to update token
2025-10-01T14:15:20.888730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:20.901763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId: src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:20.904147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:20.951838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256742410465177:3353]
2025-10-01T14:15:20.952075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2509, pipe: [1:7556256742410465177:3353]
2025-10-01T14:15:21.029015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:21.029376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.029391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.029413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256742410465177:3353], now have 1 active actors on pipe
2025-10-01T14:15:21.029656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:21.029651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:21.029666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:21.029669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256742410465177:3353]
2025-10-01T14:15:21.029691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:21.029705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-01T14:15:21.029726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2510 reason: error at write: Disconnected sessionId: src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0
2025-10-01T14:15:21.029884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2510 sessionId: src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0 is DEAD
2025-10-01T14:15:21.030011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:21.030021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Write session will restart in 0.009078s
2025-10-01T14:15:21.030042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Write session: Do CDS request
2025-10-01T14:15:21.030047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:21.037081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:21.038315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:21.038490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:21.038499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:21.038509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:21.038549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:21.038585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256744328512150:7688]
2025-10-01T14:15:21.039154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:21.039453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:21.039487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:21.039775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:21.039825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.039831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.039832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.039833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.039834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.039835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.039837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.039858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.039838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.039839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.039840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.039841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.039842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.039843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.039844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.039848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.039857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.039861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.039865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.039868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.039872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.039875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.039878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.039882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.039886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.039890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.039893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.039896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.039900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.039906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.039913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.039918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.039924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.039928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.039932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.039937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.039942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.039946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.039925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:21.039951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.039935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2511
2025-10-01T14:15:21.039955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.039961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.039965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.039970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.039975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.039979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.039983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.039987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.039991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.039995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.039998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.040001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.040004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.040009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.040018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.040022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.040026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.040031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.040071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:21.040064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.040116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:21.040127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:21.040131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:21.040501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2511 sessionId:  describe result for acl check
2025-10-01T14:15:21.040546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:21.040551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:21.040552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:21.040555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256746705432544:3202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:21.040947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256746705432544:3202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:21.042520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256746705432544:3202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:21.043587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:21.044261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:21.044278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:21.044281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:21.044284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:21.044291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2510 [2:7556256744328512150:7688]
2025-10-01T14:15:21.044306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:21.044321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:21.044324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.044327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.044329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.044345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:21.044351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:21.044363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:21.044425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.044432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.044434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.044437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:21.044439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:21.044548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256746705432544:3202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:21.044558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256746705432544:3202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:21.044581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:21.044560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256746705432544:3202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:21.044590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.044565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:21.044601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.044616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.044610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2510
2025-10-01T14:15:21.044635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:21.044655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432480:2446], now have 1 active actors on pipe
2025-10-01T14:15:21.044666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.044672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.044674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.044678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2510
2025-10-01T14:15:21.044685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:21.044691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:21.044694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:21.044696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:21.044715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:21.044727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:21.044729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:21.044733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432578:3202], now have 1 active actors on pipe
2025-10-01T14:15:21.044742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.044745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.044800Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:15:21.044818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.044827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:21.044838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:21.044844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:21.044847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.044850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.044851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:21.044858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.044867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:21.044892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.044933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 23 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:15:21.044960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:15:21.045013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.045018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.045034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.045101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2511 partition: 0 MaxSeqNo: 45 sessionId: src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0
2025-10-01T14:15:21.045381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d96f41-78fd81ae-60684ff9-e785bea3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:21.047864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Write session: try to update token
2025-10-01T14:15:21.047886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:21.060560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId: src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:21.062679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:21.064199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.064221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.064238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:21.064241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.064242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:21.064244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:21.064252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.064255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.064259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256744328512145:7688]
2025-10-01T14:15:21.064298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:21.064307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.064309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:21.064309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:21.064314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:21.064317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:21.064441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:21.130006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256746705432602:3353]
2025-10-01T14:15:21.130256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2510, pipe: [1:7556256746705432602:3353]
2025-10-01T14:15:21.198698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:21.198932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:21.198984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432602:3353], now have 1 active actors on pipe
2025-10-01T14:15:21.199058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:21.199156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256746705432602:3353]
2025-10-01T14:15:21.199181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:21.207202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:21.207947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:21.207957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:21.207978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2511 reason: error at write: Disconnected sessionId: src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0
2025-10-01T14:15:21.208084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2511 sessionId: src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0 is DEAD
2025-10-01T14:15:21.208237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:21.208246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Write session will restart in 0.007369s
2025-10-01T14:15:21.208270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Write session: Do CDS request
2025-10-01T14:15:21.208276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:21.213641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:21.213892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:21.213902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:21.213915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:21.213969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:21.214008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256744328512251:7687]
2025-10-01T14:15:21.214527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:21.214856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:21.214911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:21.215411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:21.215469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.215474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.215475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.215477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.215478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.215479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.215481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.215483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.215484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.215485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.215486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.215488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.215489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.215490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.215496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.215506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.215510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.215514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.215518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.215522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.215526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.215529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.215533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.215536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.215540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.215543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.215547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.215551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.215559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.215567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.215578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.215583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.215591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.215600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.215604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.215609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.215613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.215622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.215628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.215635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.215643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.215648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.215656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.215661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.215669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.215678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.215687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.215695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.215700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.215705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.215709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.215717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.215726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.215731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.215739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.215744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.215784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:21.216837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.216906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:21.216917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2512
2025-10-01T14:15:21.217034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.217057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:21.217064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:21.217067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:21.217360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2512 sessionId:  describe result for acl check
2025-10-01T14:15:21.217383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:21.217388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:21.217389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:21.217392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256746705432672:3191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:21.217763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256746705432672:3191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:21.219427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:21.220072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:21.220082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:21.220084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:21.220087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:21.220094Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2511 [2:7556256744328512251:7687]
2025-10-01T14:15:21.220108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:21.220127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:21.220134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.220137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.220139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.220153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:21.220158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:21.220164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:21.220219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.220206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256746705432672:3191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:21.220225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.220228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.220231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:21.220234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:21.220295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:21.220301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.220312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.220325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.220345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:21.220366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432606:2446], now have 1 active actors on pipe
2025-10-01T14:15:21.220376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.220370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2511
2025-10-01T14:15:21.220378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.220379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.220389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:21.220398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:21.220408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:21.220411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:21.220416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:21.220419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:21.220420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:21.220451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.220460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:21.220476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:21.225162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256746705432672:3191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:21.225175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256746705432672:3191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:21.225179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256746705432672:3191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:21.225186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:21.225385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432710:3191], now have 1 active actors on pipe
2025-10-01T14:15:21.225408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2511
2025-10-01T14:15:21.225469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.225480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.225499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:21.225510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.225514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.225519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:21.225527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.225543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:21.225560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.225666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.225671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.225680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.225752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2512 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0
2025-10-01T14:15:21.226018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10075d28-da9cd74-b45e29cf-558a5e7a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:21.228290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Write session: try to update token
2025-10-01T14:15:21.228303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:21.231008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:21.231024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.231034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.231074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:21.231086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:21.231251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:21.231392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.231538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.231694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.231906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:21.231939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:21.243535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId: src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:21.245874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:21.246048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.246067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.246103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:21.246164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:21.248796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:21.248812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.248816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:21.248818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:21.248827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.248829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.248832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256744328512245:7687]
2025-10-01T14:15:21.248868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:21.248873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.248875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:21.248885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:21.248895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:21.248899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:21.248992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:21.299489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256746705432714:3353]
2025-10-01T14:15:21.299727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2511, pipe: [1:7556256746705432714:3353]
2025-10-01T14:15:21.387890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:21.395208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.395232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.395393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.395448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.395507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.395567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.395612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.395624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.395700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.395780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.395838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.395896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.395936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.395941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.396008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.396067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.396126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.396188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.396228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.396233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.396296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.396356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.396416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.396477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.396521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.396530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.396616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.396671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.396726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.396782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.396826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.396832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.396893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.396948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.397007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.397069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.397108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.397116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.397177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.397232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.397293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.397351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.397391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.397395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.397469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.397533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.397598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.397666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.397712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.397717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.397781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.397835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.397894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.397952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.397998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.398003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.398060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:21.398129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:21.398203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:21.398276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:21.398327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:21.398334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:21.398412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432714:3353], now have 1 active actors on pipe
2025-10-01T14:15:21.398600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:21.398612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:21.398636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2512 reason: error at write: Disconnected sessionId: src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0
2025-10-01T14:15:21.398819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2512 sessionId: src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0 is DEAD
2025-10-01T14:15:21.398945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:21.398955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Write session will restart in 0.007174s
2025-10-01T14:15:21.398980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Write session: Do CDS request
2025-10-01T14:15:21.398994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:21.398980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:21.399013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256746705432714:3353]
2025-10-01T14:15:21.399206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:21.406291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:21.406858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.406953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:21.406964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2513
2025-10-01T14:15:21.407079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.407110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:21.407118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:21.407121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:21.407457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2513 sessionId:  describe result for acl check
2025-10-01T14:15:21.407485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:21.407489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:21.407491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:21.407494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256746705432802:3128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:21.407695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:21.407864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:21.407874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:21.407884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:21.407874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256746705432802:3128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:21.407936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:21.407975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256744328512361:7671]
2025-10-01T14:15:21.408720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:21.408946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:21.408992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:21.409305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:21.409359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.409365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.409366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.409367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.409368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.409369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.409370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.409372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.409373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.409374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.409375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.409376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.409378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.409379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.409383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.409392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.409396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.409400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.409404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.409408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.409411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.409418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.409420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.409422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.409425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.409431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.409433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.409435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.409440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.409448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.409452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.409458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.409460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.409464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.409467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.409469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.409476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.409479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.409481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.409484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.409487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.409489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.409491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.409497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.409501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.409504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.409507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.409509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.409512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.409514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.409517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.409519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.409521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.409524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.409529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.409532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.409552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:21.410007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256746705432802:3128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:21.412583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256746705432802:3128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:21.412602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256746705432802:3128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:21.412605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256746705432802:3128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:21.412610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:21.412888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:21.413541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:21.413558Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:21.413561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:21.413565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:21.413571Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2512 [2:7556256744328512361:7671]
2025-10-01T14:15:21.413586Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:21.413604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:21.413613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.413616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.413618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.413633Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:21.413642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:21.413647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:21.413699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.413705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.413706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.413709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:21.413711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:21.413781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:21.413787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.413799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.413813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.413832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:21.413852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432732:2446], now have 1 active actors on pipe
2025-10-01T14:15:21.413858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432837:3128], now have 1 active actors on pipe
2025-10-01T14:15:21.413866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.413868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.413869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.413883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:21.413899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:21.413888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2512
2025-10-01T14:15:21.413902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:21.413894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2512
2025-10-01T14:15:21.413905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:21.413907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:21.413915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:21.413918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:21.413939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.413950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:21.413967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:21.413969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.413973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.414010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:21.414022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.414029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.414035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:21.414043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.414054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:21.414073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.414192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.414198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.414211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.414296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2513 partition: 0 MaxSeqNo: 45 sessionId: src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0
2025-10-01T14:15:21.414593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c099c2-a68d7ec5-50669c5-2b628041_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:21.416859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Write session: try to update token
2025-10-01T14:15:21.416873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:21.429874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId: src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:21.432269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:21.433163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.433183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.433202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:21.433208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.433211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:21.433215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:21.433223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.433231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.433235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256744328512356:7671]
2025-10-01T14:15:21.433268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:21.433277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:21.433279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:21.433293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:21.433307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.433309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:21.433441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:21.499163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256746705432846:3353]
2025-10-01T14:15:21.499416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2512, pipe: [1:7556256746705432846:3353]
2025-10-01T14:15:21.572025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:21.572467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:21.572523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432846:3353], now have 1 active actors on pipe
2025-10-01T14:15:21.572600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:21.572686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:21.572735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256746705432846:3353]
2025-10-01T14:15:21.579650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:21.581357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:21.581523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:21.581532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:21.581542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:21.581583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:21.581623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256744328512460:7669]
2025-10-01T14:15:21.582176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:21.582431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:21.582441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:21.582460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2513 reason: error at write: Disconnected sessionId: src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0
2025-10-01T14:15:21.582583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2513 sessionId: src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0 is DEAD
2025-10-01T14:15:21.582720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:21.582730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Write session will restart in 0.008633s
2025-10-01T14:15:21.582754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Write session: Do CDS request
2025-10-01T14:15:21.582759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:21.587208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:21.587253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:21.587567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:21.587613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.587618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.587619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.587620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.587621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.587622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.587623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.587624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.587625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.587626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.587627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.587628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.587629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.587630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.587635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.587645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.587648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.587652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.587655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.587659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.587662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.587666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.587669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.587673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.587677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.587680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.587684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.587687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.587697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.587708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.587717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.587726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.587734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.587743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.587751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.587760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.587766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.587774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.587782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.587786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.587794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.587799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.587803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.587808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.587816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.587824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.587832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.587837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.587845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.587849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.587854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.587862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.587871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.587878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.587886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.587890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.587930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:21.591297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:21.592026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:21.592037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:21.592039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:21.592041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:21.592047Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2513 [2:7556256744328512460:7669]
2025-10-01T14:15:21.592059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:21.592073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:21.592076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.592079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.592081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.592093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:21.592099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:21.592105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:21.592148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.592154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.592156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.592159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:21.592162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:21.592216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:21.592226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.592235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.592245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.592261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:21.592278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432851:2446], now have 1 active actors on pipe
2025-10-01T14:15:21.592289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.592295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.592297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.592308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:21.592325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:21.592325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:21.592330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:21.592331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:21.592342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:21.592344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:21.592364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.592376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:21.592382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:21.592360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2513
2025-10-01T14:15:21.592850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.592910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:21.592921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2514
2025-10-01T14:15:21.593034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.593057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:21.593063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:21.593065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:21.593355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2514 sessionId:  describe result for acl check
2025-10-01T14:15:21.593381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:21.593386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:21.593387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:21.593390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256746705432921:3125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:21.593906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256746705432921:3125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:21.596171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256746705432921:3125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:21.601305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256746705432921:3125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:21.601315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256746705432921:3125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:21.601318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256746705432921:3125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:21.601323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:21.601540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2513
2025-10-01T14:15:21.602243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432958:3125], now have 1 active actors on pipe
2025-10-01T14:15:21.602267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.602274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.602289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:21.602292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.602301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.602339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:21.602356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:21.602384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.602389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.602393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:21.602402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.602419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:21.602436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:21.602595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:21.602724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.602852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.602985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.603167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:21.603206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.603226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:21.603390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.603398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.603410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.603489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2514 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0
2025-10-01T14:15:21.603762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae03bf0-e7eb1409-85030d16-8d549ed7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:21.606101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Write session: try to update token
2025-10-01T14:15:21.606114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:21.621145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:21.621161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.621163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:21.621165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:21.621174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.621177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.621180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256744328512455:7669]
2025-10-01T14:15:21.621225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:21.621234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.621236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:21.621238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:21.621250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:21.621254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:21.621372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:21.623945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId: src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:21.626429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:21.672724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256746705432965:3353]
2025-10-01T14:15:21.672948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2513, pipe: [1:7556256746705432965:3353]
2025-10-01T14:15:21.759843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:21.760101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.760113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.760131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432965:3353], now have 1 active actors on pipe
2025-10-01T14:15:21.760297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:21.760305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:21.760315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:21.760334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256746705432965:3353]
2025-10-01T14:15:21.760353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:21.760361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2514 reason: error at write: Disconnected sessionId: src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0
2025-10-01T14:15:21.760494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2514 sessionId: src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0 is DEAD
2025-10-01T14:15:21.760643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:21.760654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Write session will restart in 0.009766s
2025-10-01T14:15:21.760675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Write session: Do CDS request
2025-10-01T14:15:21.760681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:21.767538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:21.768846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:21.769014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:21.769022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:21.769032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:21.769073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:21.769098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256744328512586:7662]
2025-10-01T14:15:21.769499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:21.769690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:21.769717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:21.769914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:21.769949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.769953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.769954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.769954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.769955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.769955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.769956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.769957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.769957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.769958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.769958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.769959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.769960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.769960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.769963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.769969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.769971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.769973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.769975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.769978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.769979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.769981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.769983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.769986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.769988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.769990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.769992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.769994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.769998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.770003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.770006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.770009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.770012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.770014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.770017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.770019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.770021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.770024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.770026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.770029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.770031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.770034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.770036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.770038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.770041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.770044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.770048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.770050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.770052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.770055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.770057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.770060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.770063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.770065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.770067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.770070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.770088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:21.771796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.771895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:21.771906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2515
2025-10-01T14:15:21.771990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.772019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:21.772026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:21.772029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:21.772288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2515 sessionId:  describe result for acl check
2025-10-01T14:15:21.772312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:21.772317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:21.772318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:21.772320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256746705433038:3115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:21.772713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256746705433038:3115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:21.773350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:21.773914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256746705433038:3115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:21.773981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:21.773994Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:21.773996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:21.773999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:21.774005Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2514 [2:7556256744328512586:7662]
2025-10-01T14:15:21.774019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:21.774036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:21.774040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.774043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.774044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.774055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:21.774062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:21.774066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:21.774105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.774110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.774111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.774113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:21.774114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:21.774162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:21.774167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.774173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.774179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.774190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:21.774205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705432966:2446], now have 1 active actors on pipe
2025-10-01T14:15:21.774213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.774217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.774218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.774227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:21.774238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:21.774245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:21.774252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:21.774253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:21.774244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2514
2025-10-01T14:15:21.774254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:21.774255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:21.774276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.774282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:21.774291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:21.778684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256746705433038:3115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:21.778698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256746705433038:3115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:21.778700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256746705433038:3115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:21.778708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:21.778943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705433073:3115], now have 1 active actors on pipe
2025-10-01T14:15:21.779134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2514
2025-10-01T14:15:21.779205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.779218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.779246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:21.779256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.779264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.779267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:21.779278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.779294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:21.779309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.779476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.779483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.779493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.779557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2515 partition: 0 MaxSeqNo: 45 sessionId: src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0
2025-10-01T14:15:21.779856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa3071f-c2897224-f43ced65-e5a642c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:21.782279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Write session: try to update token
2025-10-01T14:15:21.782295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:21.784229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:21.784242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.784249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.784281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:21.784301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:21.784444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:21.784592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.784749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.784874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.785086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:21.785122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:21.799113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId: src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:21.802063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:21.802660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.802681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.802698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:21.802700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.802702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:21.802703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:21.802712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.802714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.802716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256744328512581:7662]
2025-10-01T14:15:21.802750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:21.802755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:21.802760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.802761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:21.802762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:21.802768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:21.802872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:21.860647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256746705433077:3353]
2025-10-01T14:15:21.860939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2514, pipe: [1:7556256746705433077:3353]
2025-10-01T14:15:21.935976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:21.936399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:21.936433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705433077:3353], now have 1 active actors on pipe
2025-10-01T14:15:21.936540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:21.936624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:21.936624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256746705433077:3353]
2025-10-01T14:15:21.936631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:21.936654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:21.936692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2515 reason: error at write: Disconnected sessionId: src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0
2025-10-01T14:15:21.936822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2515 sessionId: src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0 is DEAD
2025-10-01T14:15:21.936947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:21.936956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Write session will restart in 0.008993s
2025-10-01T14:15:21.936974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Write session: Do CDS request
2025-10-01T14:15:21.936980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:21.944153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:21.945570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:21.945768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:21.945778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:21.945788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:21.945832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:21.945868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256744328512706:7645]
2025-10-01T14:15:21.946342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:21.946631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:21.946678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:21.946891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.946952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:21.946936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:21.946946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2516
2025-10-01T14:15:21.947008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.947014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.947015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.947016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.947017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.947017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.947018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.947019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.947020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.947021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.947022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.947023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.947024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.947025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.947029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.947050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.947058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.947061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.947065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.947069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.947073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.947077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.947084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.947087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.947094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.947098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.947101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.947108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.947116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:21.947115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.947126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:21.947132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.947136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:21.947141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.947148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:21.947151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.947150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:21.947156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:21.947160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.947159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:21.947165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:21.947162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:21.947169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.947173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:21.947178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.947183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:21.947188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.947192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:21.947196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.947201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:21.947205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.947209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.947213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.947217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.947221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.947231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.947235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.947244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:21.947248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.947252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:21.947287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:21.947522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2516 sessionId:  describe result for acl check
2025-10-01T14:15:21.947552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:21.947553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:21.947555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:21.947560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256746705433147:3107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:21.948054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256746705433147:3107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:21.949657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256746705433147:3107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:21.950672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:21.951420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:21.951434Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:21.951437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:21.951439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:21.951446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2515 [2:7556256744328512706:7645]
2025-10-01T14:15:21.951461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:21.951476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:21.951482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.951486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.951488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.951507Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:21.951516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:21.951521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:21.951569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.951575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.951576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.951579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:21.951581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:21.951650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:21.951659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.951668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:21.951677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:21.951690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:21.951710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705433078:2446], now have 1 active actors on pipe
2025-10-01T14:15:21.951705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2515
2025-10-01T14:15:21.951720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.951726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.951728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.951736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:21.951743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:21.951746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:21.951748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:21.951753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:21.951766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:21.951772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:21.951798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.951809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:21.951816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:21.951826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256746705433147:3107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:21.951838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256746705433147:3107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:21.951842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256746705433147:3107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:21.951848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:21.952013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256746705433182:3107], now have 1 active actors on pipe
2025-10-01T14:15:21.952071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2515
2025-10-01T14:15:21.952122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.952133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.952157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:21.952167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:21.952174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:21.952176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:21.952184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:21.952195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:21.952214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.952351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.952363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.952385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:21.952447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2516 partition: 0 MaxSeqNo: 45 sessionId: src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0
2025-10-01T14:15:21.952722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414eb8fb-603b1480-d8017617-bcb7bc2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:21.955005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Write session: try to update token
2025-10-01T14:15:21.955018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:21.961796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:21.961805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.961821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.961851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:21.961861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:21.962164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:21.962310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.962456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.962601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:21.962788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:21.962822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:21.974545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId: src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:21.977116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:21.977305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:21.977325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:21.977360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:21.977434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:21.980331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:21.980349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:21.980352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:21.980354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:21.980365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.980373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.980378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256744328512701:7645]
2025-10-01T14:15:21.980427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:21.980430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:21.980437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:21.980438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:21.980440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:21.980442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:21.980636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:22.036801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256751000400488:3353]
2025-10-01T14:15:22.037126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2515, pipe: [1:7556256751000400488:3353]
2025-10-01T14:15:22.120343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:22.127694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.127716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.127849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.127900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.127954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.128005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.128205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.128215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.128271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.128324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.128376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.128430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.128468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.128473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.128553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.128608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.128662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.128721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.128756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.128757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.128816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.128870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.128921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.128991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.129039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.129047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.129111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.129170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.129232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.129297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.129338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.129345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.129408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.129468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.129535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.129600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.129651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.129656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.129722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.129779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.129847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.129909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.130028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.130036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.130103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.130163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.130223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.130288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.130334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.130340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.130424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.130485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.131271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:22.131285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:22.131302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256751000400488:3353]
2025-10-01T14:15:22.131313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2516 reason: error at write: Disconnected sessionId: src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0
2025-10-01T14:15:22.131323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:22.131555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2516 sessionId: src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0 is DEAD
2025-10-01T14:15:22.130550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.130619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.130659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.130661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.130728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.130790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.130852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.130908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.130948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.130951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.131017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400488:3353], now have 1 active actors on pipe
2025-10-01T14:15:22.131677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:22.133107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:22.133117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Write session will restart in 0.009382s
2025-10-01T14:15:22.133144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Write session: Do CDS request
2025-10-01T14:15:22.133150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:22.142787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:22.143778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.143855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:22.143871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2517
2025-10-01T14:15:22.143971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.144003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:22.144015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:22.144018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:22.144362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2517 sessionId:  describe result for acl check
2025-10-01T14:15:22.144401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:22.144406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:22.144410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:22.144414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256751000400572:3077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:22.144530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:22.144694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:22.144701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:22.144708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:22.144743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:22.144767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256748623480106:7631]
2025-10-01T14:15:22.144905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256751000400572:3077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:22.145147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:22.145332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:22.145375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:22.145588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:22.145625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.145629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.145630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.145631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.145631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.145632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.145633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.145633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.145634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.145635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.145635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.145636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.145636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.145637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.145640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.145646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.145648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.145650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.145652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.145654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.145656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.145658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.145660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.145662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.145664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.145666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.145669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.145670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.145675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.145679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.145683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.145686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.145689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.145691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.145694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.145697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.145699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.145702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.145704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.145707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.145710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.145712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.145715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.145718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.145720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.145723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.145725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.145728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.145730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.145733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.145735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.145738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.145741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.145744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.145746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.145749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.145768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:22.146426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256751000400572:3077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:22.149083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256751000400572:3077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:22.149102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256751000400572:3077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:22.149106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256751000400572:3077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:22.149113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:22.149274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:22.150002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:22.150013Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:22.150016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:22.150019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:22.150025Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2516 [2:7556256748623480106:7631]
2025-10-01T14:15:22.150040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:22.150055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:22.150058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.150061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.150063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.150078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:22.150083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:22.150088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:22.150137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.150145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.150146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.150149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:22.150152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:22.150213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:22.150220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.150231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.150242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.150261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:22.150280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400610:3077], now have 1 active actors on pipe
2025-10-01T14:15:22.150288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400503:2446], now have 1 active actors on pipe
2025-10-01T14:15:22.150294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.150296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.150298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.150308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:22.150318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:22.150321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:22.150322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:22.150327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:22.150340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:22.150331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2516
2025-10-01T14:15:22.150346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:22.150384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.150394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:22.150398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:22.150408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.150415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.150409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2516
2025-10-01T14:15:22.150459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:22.150469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.150473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.150475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:22.150483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.150491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:22.150510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.150650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.150657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.150669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.150731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2517 partition: 0 MaxSeqNo: 45 sessionId: src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0
2025-10-01T14:15:22.151030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976cf46-da5a96c4-e7a06ac9-2d44c28b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:22.153538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Write session: try to update token
2025-10-01T14:15:22.153551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:22.168475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId: src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:22.171134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:22.171156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:22.171160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:22.171162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:22.171171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.171175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.171179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256748623480100:7631]
2025-10-01T14:15:22.171225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:22.171229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:22.171235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.171238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:22.171240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:22.171242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:22.171420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:22.171911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:22.231321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256751000400617:3353]
2025-10-01T14:15:22.231568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2516, pipe: [1:7556256751000400617:3353]
2025-10-01T14:15:22.309208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:22.309465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.309475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.309508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400617:3353], now have 1 active actors on pipe
2025-10-01T14:15:22.309674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:22.309750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:22.309764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:22.309770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:22.309814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256751000400617:3353]
2025-10-01T14:15:22.309821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2517 reason: error at write: Disconnected sessionId: src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0
2025-10-01T14:15:22.309977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2517 sessionId: src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0 is DEAD
2025-10-01T14:15:22.310155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:22.310166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Write session will restart in 0.008757s
2025-10-01T14:15:22.310194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Write session: Do CDS request
2025-10-01T14:15:22.310199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:22.318052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:22.319613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:22.319803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:22.319813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:22.319823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:22.319855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.319864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:22.319913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256748623480211:7623]
2025-10-01T14:15:22.319926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:22.319937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2518
2025-10-01T14:15:22.320041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.320061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:22.320068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:22.320070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:22.320355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2518 sessionId:  describe result for acl check
2025-10-01T14:15:22.320380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:22.320381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:22.320382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:22.320385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256751000400686:3062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:22.320442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:22.320685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:22.320722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:22.320763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256751000400686:3062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:22.320990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:22.321041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.321047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.321048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.321048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.321049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.321050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.321051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.321052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.321053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.321054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.321055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.321056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.321057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.321057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.321062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.321070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.321073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.321076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.321079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.321082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.321085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.321088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.321091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.321094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.321097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.321100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.321103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.321107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.321112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.321118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.321133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.321141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.321150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.321158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.321165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.321169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.321178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.321186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.321193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.321197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.321204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.321209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.321216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.321220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.321226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.321234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.321238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.321242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.321245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.321253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.321260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.321264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.321271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.321275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.321282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.321286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.321331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:22.322468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256751000400686:3062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:22.324438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256751000400686:3062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:22.324448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256751000400686:3062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:22.324451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256751000400686:3062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:22.324456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:22.324703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:22.325334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:22.325348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:22.325351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:22.325354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:22.325360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2517 [2:7556256748623480211:7623]
2025-10-01T14:15:22.325378Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:22.325396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:22.325403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.325407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.325409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.325422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:22.325428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:22.325437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:22.325490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.325497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.325499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.325502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:22.325504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:22.325562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:22.325569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.325580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.325595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.325611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:22.325632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400619:2446], now have 1 active actors on pipe
2025-10-01T14:15:22.325642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400725:3062], now have 1 active actors on pipe
2025-10-01T14:15:22.325648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.325650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.325640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2517
2025-10-01T14:15:22.325652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.325667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:22.325659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2517
2025-10-01T14:15:22.325679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:22.325686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:22.325689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:22.325691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:22.325693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:22.325696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:22.325722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.325733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:22.325738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:22.325750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.325758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.325800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:22.325810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.325818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.325825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:22.325833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.325844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:22.325860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.325988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.325997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.326009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.326078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2518 partition: 0 MaxSeqNo: 45 sessionId: src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0
2025-10-01T14:15:22.326366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82c84cb3-a65f6cec-57f1ab1e-f5f30c23_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:22.328677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Write session: try to update token
2025-10-01T14:15:22.328690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:22.342057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId: src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:22.344230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:22.345096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.345118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.345138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:22.345141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:22.345144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:22.345145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:22.345154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.345159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.345164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256748623480206:7623]
2025-10-01T14:15:22.345211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:22.345226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:22.345227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:22.345230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:22.345231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.345233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:22.345354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:22.410014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256751000400745:3353]
2025-10-01T14:15:22.410305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2517, pipe: [1:7556256751000400745:3353]
2025-10-01T14:15:22.482633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:22.482891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:22.482946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400745:3353], now have 1 active actors on pipe
2025-10-01T14:15:22.483052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:22.483161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256751000400745:3353]
2025-10-01T14:15:22.483178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:22.483181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:22.483194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2518 reason: error at write: Disconnected sessionId: src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0
2025-10-01T14:15:22.483204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:22.483323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2518 sessionId: src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0 is DEAD
2025-10-01T14:15:22.483454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:22.483465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Write session will restart in 0.005542s
2025-10-01T14:15:22.483490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Write session: Do CDS request
2025-10-01T14:15:22.483496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:22.489778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.489902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:22.489911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2519
2025-10-01T14:15:22.490014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.490036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:22.490043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:22.490045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:22.490454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2519 sessionId:  describe result for acl check
2025-10-01T14:15:22.490490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:22.490495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:22.490497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:22.490501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256751000400806:3031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:22.491018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256751000400806:3031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:22.492051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:22.493125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256751000400806:3031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:22.495393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:22.495639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:22.495650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:22.495662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:22.495710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256751000400806:3031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:22.495726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256751000400806:3031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:22.495729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256751000400806:3031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:22.495719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:22.495737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:22.495768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256748623480324:7608]
2025-10-01T14:15:22.496226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:22.496568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:22.496670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:22.497056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:22.497133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.497141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.497142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.497143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.497145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.497146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.497148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.497149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.497150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.497152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.497153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.497154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.497156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.497158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.497165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.497175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.497179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.497183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.497187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.497192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.497196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.497200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.497204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.497208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.497212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.497215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.497220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.497223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.497232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.497241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.497247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.497253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.497260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.497265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.497270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.497276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.497281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.497303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.497315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.497320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.497325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.497331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.497336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.497346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.497351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.497361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.497364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.497367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.497371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.497374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.497377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.497380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.497390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.497393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.497395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.497405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.497444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:22.501179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:22.501841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:22.501859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:22.501862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:22.501867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:22.501875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2518 [2:7556256748623480324:7608]
2025-10-01T14:15:22.501893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:22.501917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:22.501925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.501928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.501930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.501942Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:22.501945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:22.501951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:22.502014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.502024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.502026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.502028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:22.502031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:22.502091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:22.502098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.502106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.502112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.502126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:22.502143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400861:3031], now have 1 active actors on pipe
2025-10-01T14:15:22.502151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400756:2446], now have 1 active actors on pipe
2025-10-01T14:15:22.502156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.502158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.502160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.502171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:22.502186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:22.502186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:22.502190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:22.502192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:22.502200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:22.502203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:22.502232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.502240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:22.502222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2518
2025-10-01T14:15:22.502224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2518
2025-10-01T14:15:22.502265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.502274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.502277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:22.502305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:22.502315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.502319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.502320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:22.502328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.502338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:22.502354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.502539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.502556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.502582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.502688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2519 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0
2025-10-01T14:15:22.503045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e18e14-ca5e3815-cf5907ad-1b325654_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:22.505532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Write session: try to update token
2025-10-01T14:15:22.505547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:22.517721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId: src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:22.519947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:22.520135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.520160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.522232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:22.522269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:22.522273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:22.522276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:22.522278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:22.522288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.522294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.522299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256748623480318:7608]
2025-10-01T14:15:22.522336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:22.522346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:22.522366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:22.522353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.522355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:22.522389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:22.522396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:22.522526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:22.583074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256751000400875:3353]
2025-10-01T14:15:22.583334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2518, pipe: [1:7556256751000400875:3353]
2025-10-01T14:15:22.659467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:22.668228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.668256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.668440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.668509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.668616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.668710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.668773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.668783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.668872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.668946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.669020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.669103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.669157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.669166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.669236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.669301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.669370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.669434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.669479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.669485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.669553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.669617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.669681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.669747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.669787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.669793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.669855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.669912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.669972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.670036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.670076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.670081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.670159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.670225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.670292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.670365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.670459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.670467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.670543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.670609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.670678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.670747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.670795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.670803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.670881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.670946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.671020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.671101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.671161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.671166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.671247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.671315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.671387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.671455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.671510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.671516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.671597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.671659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.671730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.671799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.671846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.671851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.671913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400875:3353], now have 1 active actors on pipe
2025-10-01T14:15:22.672160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256751000400875:3353]
2025-10-01T14:15:22.672186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:22.672187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:22.672189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:22.672217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2519 reason: error at write: Disconnected sessionId: src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0
2025-10-01T14:15:22.672414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2519 sessionId: src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0 is DEAD
2025-10-01T14:15:22.672566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:22.672574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Write session will restart in 0.005401s
2025-10-01T14:15:22.672601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Write session: Do CDS request
2025-10-01T14:15:22.672606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:22.672984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:22.678755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.678811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:22.678824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2520
2025-10-01T14:15:22.678933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.678955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:22.678962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:22.678965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:22.679320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2520 sessionId:  describe result for acl check
2025-10-01T14:15:22.679344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:22.679349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:22.679350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:22.679354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256751000400948:3002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:22.679823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256751000400948:3002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:22.680146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:22.681490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:22.681609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256751000400948:3002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:22.681644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:22.681653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:22.681673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:22.681716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:22.681748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256748623480441:7617]
2025-10-01T14:15:22.682290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:22.682637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:22.682702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:22.683012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:22.683060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.683066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.683067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.683068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.683070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.683072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.683073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.683073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.683074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.683075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.683077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.683078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.683079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.683084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.683092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.683096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.683100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.683104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.683108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.683111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.683115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.683118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.683122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.683126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.683129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.683132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.683136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.683142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.683147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.683151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.683154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.683156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.683159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.683161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.683164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.683166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.683169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.683171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.683174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.683176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.683179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.683181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.683184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.683186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.683189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.683192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.683195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.683199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.683204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.683208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.683212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.683217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.683221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.683223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.683225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.683245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:22.685404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256751000400948:3002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:22.685414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256751000400948:3002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:22.685417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256751000400948:3002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:22.685433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:22.686601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:22.687191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:22.687204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:22.687206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:22.687210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:22.687216Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2519 [2:7556256748623480441:7617]
2025-10-01T14:15:22.687229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:22.687245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:22.687251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.687257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.687259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.687273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:22.687282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:22.687287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:22.687337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.687341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.687343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.687346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:22.687349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:22.687409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:22.687416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.687426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.687440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.687458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:22.687474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400883:2446], now have 1 active actors on pipe
2025-10-01T14:15:22.687480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400990:3002], now have 1 active actors on pipe
2025-10-01T14:15:22.687485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.687486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.687488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.687496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:22.687508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:22.687510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:22.687513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:22.687515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:22.687522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:22.687524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:22.687532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2519
2025-10-01T14:15:22.687550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.687558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:22.687532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2519
2025-10-01T14:15:22.687566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:22.687591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.687595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.687617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:22.687628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.687632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.687637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:22.687645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.687652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:22.687663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.687797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.687807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.687826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.687901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2520 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0
2025-10-01T14:15:22.688177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb39c10-9acf360e-d9393809-a12b8fb0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:22.690703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Write session: try to update token
2025-10-01T14:15:22.690718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:22.702621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:22.702639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:22.702651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.702699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:22.702705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:22.703318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:22.703445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:22.703570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:22.703716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:22.703918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:22.703955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:22.705021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId: src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:22.707481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:22.707674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.707687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.707717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:22.707781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:22.715135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:22.715151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:22.715153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:22.715155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:22.715168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.715171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.715176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256748623480436:7617]
2025-10-01T14:15:22.715219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:22.715220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:22.715226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:22.715230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.715231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:22.715232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:22.715356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:22.772520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256751000400997:3353]
2025-10-01T14:15:22.772739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2519, pipe: [1:7556256751000400997:3353]
2025-10-01T14:15:22.852848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:22.859388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.859406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.859547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.859598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.859654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.859707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.859747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.859756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.859825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.859880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.859930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.859983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.860024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.860034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.860094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.860149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.860207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.860261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.860305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.860314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.860369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.860425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.860477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.860546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.860586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.860591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.860647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.860705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.860762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.860826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.860864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.860869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.860926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.860979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.861034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.861090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.861136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.861141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.861199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.861251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.861309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.861372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.861410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.861415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.861473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.861528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.861581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.861631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.861670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.861675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.861731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.861781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.861841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.861892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.861937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.861942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.861996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:22.862045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:22.862094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:22.862148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:22.862190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:22.862196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:22.862238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000400997:3353], now have 1 active actors on pipe
2025-10-01T14:15:22.862509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:22.862519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:22.862541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2520 reason: error at write: Disconnected sessionId: src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0
2025-10-01T14:15:22.862696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2520 sessionId: src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0 is DEAD
2025-10-01T14:15:22.862834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 174 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:15:22.862846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256751000400997:3353]
2025-10-01T14:15:22.862865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:22.862870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Write session will restart in 0.008698s
2025-10-01T14:15:22.862868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:22.862894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Write session: Do CDS request
2025-10-01T14:15:22.862900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:22.863083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:22.869985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:22.871538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:22.871693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:22.871700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:22.871708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:22.871742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:22.871805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256748623480579:7593]
2025-10-01T14:15:22.872216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:22.872446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:22.872480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:22.872689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:22.872726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.872730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.872731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.872731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.872732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.872733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.872733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.872734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.872734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.872735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.872736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.872736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.872737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.872737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.872741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.872747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.872749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.872751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.872753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.872755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.872757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.872771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.872773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.872776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.872778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.872783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.872785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.872787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.872792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.872796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:22.872804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.872807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:22.872805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.872809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.872815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:22.872817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.872820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:22.872823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.872825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:22.872828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.872831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:22.872834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.872837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:22.872839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.872842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:22.872848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.872851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:22.872854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.872857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.872871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.872882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.872886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.872878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:22.872894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2521
2025-10-01T14:15:22.872890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.872893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.872896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:22.872898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.872901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:22.872921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:22.872979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:22.873001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:22.873006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:22.873011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:22.873275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2521 sessionId:  describe result for acl check
2025-10-01T14:15:22.873304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:22.873308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:22.873309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:22.873313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256751000401075:2989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:22.873664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256751000401075:2989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:22.875913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256751000401075:2989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:22.876287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:22.876888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:22.876900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:22.876901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:22.876903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:22.876907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2520 [2:7556256748623480579:7593]
2025-10-01T14:15:22.876918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:22.876932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:22.876939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.876941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.876943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.876954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:22.876960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:22.876965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:22.877003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.877009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.877010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.877012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:22.877014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:22.877141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2520
2025-10-01T14:15:22.877166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:22.877173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.877184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:22.877197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:22.877211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:22.877229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000401002:2446], now have 1 active actors on pipe
2025-10-01T14:15:22.877243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.877248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.877249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.877262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:22.877274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:22.877274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:22.877277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:22.877278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:22.877285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:22.877287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:22.877308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.877316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:22.877320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:22.880632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256751000401075:2989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:22.880646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256751000401075:2989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:22.880649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256751000401075:2989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:22.880656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:22.880817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000401111:2989], now have 1 active actors on pipe
2025-10-01T14:15:22.880852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2520
2025-10-01T14:15:22.880887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.880898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.880918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ae1de87-ba408532-61fee79-e347379d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:22.880929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:22.880933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:22.880934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:22.880943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:22.880956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:22.880973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.881102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:22.881110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:22.881120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:22.881183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2521 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ae1de87-ba408532-61fee79-e347379d_0
2025-10-01T14:15:22.881468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9a2ec9-15a1cf30-8d5bdafb-a68db949_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ae1de87-ba408532-61fee79-e347379d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:22.883760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Write session: try to update token
2025-10-01T14:15:22.883774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:22.895955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId: src_id|3ae1de87-ba408532-61fee79-e347379d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:22.896546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:22.896563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:22.896567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:22.896569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:22.896578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.896583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.896586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256748623480574:7593]
2025-10-01T14:15:22.896623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:22.896627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:22.896630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:22.896633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:22.896640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:22.896646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:22.896771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:22.898162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:22.962980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256751000401118:3353]
2025-10-01T14:15:22.963236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2520, pipe: [1:7556256751000401118:3353]
2025-10-01T14:15:23.036194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:23.036481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.036495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.036548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256751000401118:3353], now have 1 active actors on pipe
2025-10-01T14:15:23.036769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:23.036777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:23.036779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:23.036815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256751000401118:3353]
2025-10-01T14:15:23.036836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2521 reason: error at write: Disconnected sessionId: src_id|3ae1de87-ba408532-61fee79-e347379d_0
2025-10-01T14:15:23.037006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2521 sessionId: src_id|3ae1de87-ba408532-61fee79-e347379d_0 is DEAD
2025-10-01T14:15:23.037116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:23.037124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Write session will restart in 0.008944s
2025-10-01T14:15:23.037143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Write session: Do CDS request
2025-10-01T14:15:23.037149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:23.036717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:23.044356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:23.045874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:23.046029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:23.046040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:23.046051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:23.046090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:23.046122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256752918447983:7591]
2025-10-01T14:15:23.046662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:23.046824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.046898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:23.046911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:23.046910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2522
2025-10-01T14:15:23.046952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:23.047021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.047052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:23.047062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:23.047070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:23.047236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:23.047287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.047293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.047294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.047295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.047296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.047297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.047298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.047300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.047301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.047302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.047303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.047304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.047305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.047307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.047311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.047320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.047324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.047328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.047331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.047335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.047339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.047342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.047346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.047350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.047353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.047356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.047360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.047364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.047371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.047378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.047388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.047397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.047405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.047410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.047417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.047422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.047430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.047435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.047443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.047448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.047456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.047460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.047424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2522 sessionId:  describe result for acl check
2025-10-01T14:15:23.047464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.047452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:23.047453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:23.047454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:23.047458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256755295368489:2966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:23.047468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.047477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.047482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.047487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.047495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.047504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.047508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.047516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.047522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.047530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.047535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.047539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.047547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.047584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:23.047906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256755295368489:2966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:23.049715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256755295368489:2966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:23.051125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:23.051773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:23.051786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:23.051788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:23.051791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:23.051797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2521 [2:7556256752918447983:7591]
2025-10-01T14:15:23.051812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:23.051832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:23.051839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.051842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.051844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.051860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:23.051873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:23.051879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:23.051929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.051935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.051937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.051940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:23.051942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:23.052004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:23.052009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.052021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.052032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.052053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:23.052072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368417:2446], now have 1 active actors on pipe
2025-10-01T14:15:23.052083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.052090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.052094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.052089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2521
2025-10-01T14:15:23.052105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:23.052117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:23.052120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:23.052122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:23.052122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:23.052135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:23.052142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:23.052169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.052180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:23.052179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256755295368489:2966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:23.052191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256755295368489:2966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:23.052195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256755295368489:2966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:23.052195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:23.052216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:23.052384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368523:2966], now have 1 active actors on pipe
2025-10-01T14:15:23.052421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2521
2025-10-01T14:15:23.052458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.052466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.052487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:23.052497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.052501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.052503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:23.052511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.052519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:23.052544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.052661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.052666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.052678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.052745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2522 partition: 0 MaxSeqNo: 45 sessionId: src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0
2025-10-01T14:15:23.053142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae1de87-ba408532-61fee79-e347379d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:23.055877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Write session: try to update token
2025-10-01T14:15:23.055894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:23.062533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:23.062549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.062555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.062593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:23.062594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:23.062748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:23.062877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.063015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.063153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.063357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:23.063397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:23.069498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId: src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:23.071965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:23.072107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.072128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.072163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:23.072236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:23.080389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:23.080403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.080405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:23.080406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:23.080415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.080418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.080422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256752918447978:7591]
2025-10-01T14:15:23.080467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:23.080468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:23.080472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:23.080475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:23.080476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.080479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:23.080608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:23.137050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256755295368544:3353]
2025-10-01T14:15:23.137308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2521, pipe: [1:7556256755295368544:3353]
2025-10-01T14:15:23.218239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:23.225078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.225104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.225238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.225292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.225345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.225403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.225446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.225453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.225509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.225564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.225616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.225676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.225720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.225731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.225799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.225856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.225911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.225963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.226005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.226010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.226067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.226133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.226190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.226243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.226286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.226292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.226347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.226414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.226468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.226518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.226557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.226562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.226620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.226683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.226738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.226793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.226836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.226841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.226896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.226945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.226995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.227047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.227089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.227098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.227159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.227212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.227266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.227316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.227353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.227358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.227410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.227456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.227506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.227556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.227651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.227658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.227714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.227764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.227816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.227877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.227919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.227925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.227971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368544:3353], now have 1 active actors on pipe
2025-10-01T14:15:23.228192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:23.228217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:23.228220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:23.228246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2522 reason: error at write: Disconnected sessionId: src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0
2025-10-01T14:15:23.228250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256755295368544:3353]
2025-10-01T14:15:23.228422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2522 sessionId: src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0 is DEAD
2025-10-01T14:15:23.228556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:23.228565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Write session will restart in 0.008800s
2025-10-01T14:15:23.228589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Write session: Do CDS request
2025-10-01T14:15:23.228594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:23.228848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:23.236323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:23.237959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:23.238115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:23.238123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:23.238130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:23.238162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:23.238188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256752918448094:7585]
2025-10-01T14:15:23.238605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:23.238855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:23.238871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.238883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:23.238961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:23.238977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2523
2025-10-01T14:15:23.239075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.239096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:23.239082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:23.239103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:23.239106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:23.239119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.239123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.239124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.239124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.239125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.239126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.239126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.239127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.239128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.239128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.239129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.239130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.239130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.239131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.239134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.239139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.239141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.239143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.239145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.239147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.239150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.239151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.239153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.239156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.239158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.239160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.239161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.239163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.239168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.239172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.239176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.239181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.239183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.239186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.239188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.239191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.239193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.239196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.239198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.239201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.239203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.239206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.239208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.239211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.239214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.239217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.239219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.239221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.239224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.239226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.239229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.239231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.239234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.239236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.239239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.239241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.239262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:23.239436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2523 sessionId:  describe result for acl check
2025-10-01T14:15:23.239473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:23.239478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:23.239479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:23.239484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256755295368620:2947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:23.239989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256755295368620:2947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:23.242143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256755295368620:2947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:23.242595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:23.243213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:23.243224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:23.243226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:23.243228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:23.243233Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2522 [2:7556256752918448094:7585]
2025-10-01T14:15:23.243241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:23.243253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:23.243258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.243261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.243262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.243273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:23.243282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:23.243286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:23.243323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.243328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.243330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.243333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:23.243334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:23.243389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:23.243396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.243405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.243419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.243436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:23.243455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368545:2446], now have 1 active actors on pipe
2025-10-01T14:15:23.243466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.243471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.243472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.243482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:23.243493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:23.243501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:23.243503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:23.243504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:23.243504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:23.243506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:23.243484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2522
2025-10-01T14:15:23.243535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.243544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:23.243556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:23.247834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256755295368620:2947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:23.247846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256755295368620:2947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:23.247849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256755295368620:2947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:23.247856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:23.248062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368659:2947], now have 1 active actors on pipe
2025-10-01T14:15:23.248109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2522
2025-10-01T14:15:23.248157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.248166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.248195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:23.248208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.248217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.248222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:23.248236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.248252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:23.248271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.248391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.248397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.248408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.248483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2523 partition: 0 MaxSeqNo: 45 sessionId: src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0
2025-10-01T14:15:23.248771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fecf06-f6fb0f0e-3112a9b0-930ce085_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:23.251185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Write session: try to update token
2025-10-01T14:15:23.251201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:23.253412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:23.253423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.253429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.253456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:23.253465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:23.253619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:23.253755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.253887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.254009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.254177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:23.254210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:23.264049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId: src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:23.266339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:23.266530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.266549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.266585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:23.266672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:23.270631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:23.270646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.270647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:23.270649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:23.270656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.270659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.270662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256752918448087:7585]
2025-10-01T14:15:23.270691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:23.270697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:23.270699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:23.270702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:23.270704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.270705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:23.270819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:23.328547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256755295368663:3353]
2025-10-01T14:15:23.328780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2522, pipe: [1:7556256755295368663:3353]
2025-10-01T14:15:23.403809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:23.410498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.410519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.410651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.410702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.410755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.410806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.411167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.411187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.411247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.411296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.411340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.411398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.411438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.411443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.411500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.411552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.411608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.411661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.411699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.411704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.411761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.411814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.411871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.411925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.411968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.411976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.412033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.412084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.412136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.412187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.412226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.412231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.412286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.412338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.412389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.412441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.412479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.412484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.412548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.412598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.412654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.412705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.412743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.412748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.412799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.412847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.412897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.412957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.413005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.413019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.413142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.413249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.413300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.413350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.413387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.413394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.413460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:23.413516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:23.413568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:23.413618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:23.413656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:23.413661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:23.413700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368663:3353], now have 1 active actors on pipe
2025-10-01T14:15:23.413842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:23.413848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256755295368663:3353]
2025-10-01T14:15:23.413872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:23.413874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:23.413895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2523 reason: error at write: Disconnected sessionId: src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0
2025-10-01T14:15:23.414084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2523 sessionId: src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0 is DEAD
2025-10-01T14:15:23.414092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:23.414178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:23.414188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Write session will restart in 0.009571s
2025-10-01T14:15:23.414214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Write session: Do CDS request
2025-10-01T14:15:23.414220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:23.421545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:23.423015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:23.423150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:23.423160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:23.423167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:23.423197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:23.423226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256752918448206:7587]
2025-10-01T14:15:23.423589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:23.423798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:23.423830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:23.424013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:23.424044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.424048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.424048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.424049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.424050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.424050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.424051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.424051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.424052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.424052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.424053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.424054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.424054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.424055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.424057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.424063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.424065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.424067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.424069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.424071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.424073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.424075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.424077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.424079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.424081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.424083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.424085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.424087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.424091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.424095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.424099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.424102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.424105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.424108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.424110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.424113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.424115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.424118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.424120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.424123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.424125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.424127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.424131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.424134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.424136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.424142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.424144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.424147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.424150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.424152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.424158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.424160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.424162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.424165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.424173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.424177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.424212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:23.424850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.424988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:23.425001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2524
2025-10-01T14:15:23.425120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.425147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:23.425156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:23.425164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:23.425510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2524 sessionId:  describe result for acl check
2025-10-01T14:15:23.425539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:23.425547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:23.425549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:23.425553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256755295368742:2949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:23.426041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256755295368742:2949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:23.427631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:23.428268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:23.428282Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:23.428284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:23.428288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:23.428294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2523 [2:7556256752918448206:7587]
2025-10-01T14:15:23.428308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:23.428324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:23.428331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.428334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.428336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.428352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:23.428360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:23.428366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:23.428416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.428422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.428424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.428427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:23.428430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:23.428492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:23.428501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.428512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.428523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.428548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:23.428567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368665:2446], now have 1 active actors on pipe
2025-10-01T14:15:23.428574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.428577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.428579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.428590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:23.428601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:23.428603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:23.428604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:23.428604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:23.428618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:23.428621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:23.428629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2523
2025-10-01T14:15:23.428675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.428686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:23.428692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:23.428730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256755295368742:2949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:23.434698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256755295368742:2949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:23.434713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256755295368742:2949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:23.434716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256755295368742:2949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:23.434725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:23.434954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368780:2949], now have 1 active actors on pipe
2025-10-01T14:15:23.435096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2523
2025-10-01T14:15:23.435136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.435146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.435167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a90ad487-3258a939-6ae688b8-c7dca472_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:23.435180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.435184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.435186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:23.435196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.435208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:23.435222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.435399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.435405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.435414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.435491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2524 partition: 0 MaxSeqNo: 45 sessionId: src_id|a90ad487-3258a939-6ae688b8-c7dca472_0
2025-10-01T14:15:23.435825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65b00e03-b622ac2d-bac6f657-b79b966e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a90ad487-3258a939-6ae688b8-c7dca472_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:23.438411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Write session: try to update token
2025-10-01T14:15:23.438428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:23.438577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:23.438593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.438599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.438646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:23.438654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:23.438802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:23.438926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.439057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.439185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:23.439359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:23.439387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:23.452286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId: src_id|a90ad487-3258a939-6ae688b8-c7dca472_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:23.454730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:23.456490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.456513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.456544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:23.456547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.456549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:23.456551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:23.456558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.456561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.456564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256752918448201:7587]
2025-10-01T14:15:23.456608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:23.456610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:23.456615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:23.456618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:23.456619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.456621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:23.456731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:23.513884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256755295368806:3353]
2025-10-01T14:15:23.514084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2523, pipe: [1:7556256755295368806:3353]
2025-10-01T14:15:23.592125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:23.592448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:23.592481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368806:3353], now have 1 active actors on pipe
2025-10-01T14:15:23.592589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:23.592649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256755295368806:3353]
2025-10-01T14:15:23.592664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:23.592676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:23.592677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:23.592738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2524 reason: error at write: Disconnected sessionId: src_id|a90ad487-3258a939-6ae688b8-c7dca472_0
2025-10-01T14:15:23.592854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2524 sessionId: src_id|a90ad487-3258a939-6ae688b8-c7dca472_0 is DEAD
2025-10-01T14:15:23.592979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:23.592988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Write session will restart in 0.009621s
2025-10-01T14:15:23.593012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Write session: Do CDS request
2025-10-01T14:15:23.593020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:23.600221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:23.601763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:23.601908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:23.601916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:23.601924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:23.601959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:23.601987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256752918448324:7580]
2025-10-01T14:15:23.602357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:23.602587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:23.602611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:23.602794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:23.602826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.602830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.602830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.602831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.602831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.602832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.602833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.602833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.602834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.602834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.602835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.602836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.602836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.602837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.602840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.602845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.602847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.602849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.602851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.602853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.602855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.602857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.602859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.602861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.602863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.602865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.602867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.602869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.602874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.602878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.602882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.602885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.602887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.602890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.602892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.602895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.602897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.602901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.602903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.602906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.602908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.602911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.602914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.602917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.602919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.602922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.602924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.602926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.602928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.602934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.602936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.602939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.602941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.602944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.602949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.602951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.602972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:23.603836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.604365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:23.604375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2525
2025-10-01T14:15:23.604459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.604489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:23.604494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:23.604497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:23.604830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2525 sessionId:  describe result for acl check
2025-10-01T14:15:23.604867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:23.604874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:23.604876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:23.604880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256755295368889:2901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:23.605388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256755295368889:2901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:23.606182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:23.606831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:23.606841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:23.606843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:23.606845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:23.606850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2524 [2:7556256752918448324:7580]
2025-10-01T14:15:23.606859Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:23.606871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:23.606876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.606878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.606879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.606889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:23.606896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:23.606900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:23.606941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.606946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.606947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.606949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:23.606950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:23.606995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:23.607002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.607009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.607014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.607023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:23.607036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.607039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.607041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.607048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:23.607058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:23.607060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:23.607061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:23.607062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368810:2446], now have 1 active actors on pipe
2025-10-01T14:15:23.607068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:23.607076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:23.607080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:23.607096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.607104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:23.607114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:23.607140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2524
2025-10-01T14:15:23.607159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256755295368889:2901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:23.612102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256755295368889:2901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:23.612115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256755295368889:2901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:23.612118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256755295368889:2901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:23.612126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:23.612333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368929:2901], now have 1 active actors on pipe
2025-10-01T14:15:23.612368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2524
2025-10-01T14:15:23.612408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.612416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.612437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|750d9f0f-dcc52547-7863fe54-98685c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:23.612447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.612455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.612457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:23.612465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.612487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:23.612506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.612625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.612632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.612643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.612695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2525 partition: 0 MaxSeqNo: 45 sessionId: src_id|750d9f0f-dcc52547-7863fe54-98685c2_0
2025-10-01T14:15:23.612998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ad487-3258a939-6ae688b8-c7dca472_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|750d9f0f-dcc52547-7863fe54-98685c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:23.615548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Write session: try to update token
2025-10-01T14:15:23.615564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:23.626276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:23.626293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.626295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:23.626298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:23.626307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.626312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.626315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256752918448319:7580]
2025-10-01T14:15:23.626359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:23.626385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.626393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:23.626392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:23.626400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:23.626406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:23.626516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:23.628349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId: src_id|750d9f0f-dcc52547-7863fe54-98685c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:23.630783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:23.692569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256755295368936:3353]
2025-10-01T14:15:23.692752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2524, pipe: [1:7556256755295368936:3353]
2025-10-01T14:15:23.744539Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 25 CurrentSessionLifetimeMs: 541762 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:15:23.760696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:23.760974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.760988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.761023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368936:3353], now have 1 active actors on pipe
2025-10-01T14:15:23.761189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:23.761246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256755295368936:3353]
2025-10-01T14:15:23.761270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:23.761274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:23.761278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:23.761332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2525 reason: error at write: Disconnected sessionId: src_id|750d9f0f-dcc52547-7863fe54-98685c2_0
2025-10-01T14:15:23.761496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2525 sessionId: src_id|750d9f0f-dcc52547-7863fe54-98685c2_0 is DEAD
2025-10-01T14:15:23.761609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:23.761619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Write session will restart in 0.005596s
2025-10-01T14:15:23.761645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Write session: Do CDS request
2025-10-01T14:15:23.761651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:23.768860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.769139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:23.769151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2526
2025-10-01T14:15:23.769238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.769260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:23.769267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:23.769269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:23.769558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:23.769609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2526 sessionId:  describe result for acl check
2025-10-01T14:15:23.769640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:23.769648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:23.769649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:23.769656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256755295369010:2884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:23.770114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256755295369010:2884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:23.771179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:23.771312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:23.771319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:23.771326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:23.771356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:23.771387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256752918448448:7576]
2025-10-01T14:15:23.771753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:23.771870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256755295369010:2884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:23.771955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:23.771994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:23.772197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:23.772231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.772235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.772236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.772236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.772237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.772238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.772238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.772239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.772239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.772240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.772240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.772241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.772241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.772242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.772245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.772250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.772252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.772254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.772256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.772258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.772260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.772262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.772264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.772266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.772268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.772270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.772272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.772274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.772278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.772282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.772286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.772288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.772291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.772294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.772296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.772298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.772301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.772304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.772306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.772309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.772313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.772316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.772318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.772320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.772324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.772327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.772330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.772333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.772335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.772338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.772340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.772342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.772345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.772347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.772349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.772352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.772371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:23.775415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256755295369010:2884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:23.775424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256755295369010:2884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:23.775427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256755295369010:2884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:23.775433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:23.775623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:23.776210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:23.776222Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:23.776224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:23.776226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:23.776230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2525 [2:7556256752918448448:7576]
2025-10-01T14:15:23.776239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:23.776249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:23.776250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.776253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.776254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.776263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:23.776267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:23.776271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:23.776305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.776310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.776311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.776313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:23.776314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:23.776356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:23.776362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.776369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.776374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.776383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:23.776397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295368937:2446], now have 1 active actors on pipe
2025-10-01T14:15:23.776402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295369050:2884], now have 1 active actors on pipe
2025-10-01T14:15:23.776406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.776408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.776410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.776421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:23.776433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:23.776435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:23.776440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:23.776441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:23.776448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:23.776449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:23.776451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2525
2025-10-01T14:15:23.776462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.776454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2525
2025-10-01T14:15:23.776468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:23.776470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:23.776557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.776564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.776586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|348264da-701493c9-de6aeb69-583b6d54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:23.776595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.776598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.776599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:23.776605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.776614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:23.776625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.776743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.776750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.776760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.776812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2526 partition: 0 MaxSeqNo: 45 sessionId: src_id|348264da-701493c9-de6aeb69-583b6d54_0
2025-10-01T14:15:23.777058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750d9f0f-dcc52547-7863fe54-98685c2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|348264da-701493c9-de6aeb69-583b6d54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:23.779408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Write session: try to update token
2025-10-01T14:15:23.779423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:23.792103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId: src_id|348264da-701493c9-de6aeb69-583b6d54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:23.794342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:23.795903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.795926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.795942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:23.795945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.795947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:23.795948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:23.795953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.795958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.795960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256752918448443:7576]
2025-10-01T14:15:23.796001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:23.796011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:23.796014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:23.796017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:23.796018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.796020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:23.796152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:23.861542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256755295369058:3353]
2025-10-01T14:15:23.861807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2525, pipe: [1:7556256755295369058:3353]
2025-10-01T14:15:23.933687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:23.933973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:23.934020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295369058:3353], now have 1 active actors on pipe
2025-10-01T14:15:23.934108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:23.934168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:23.934213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256755295369058:3353]
2025-10-01T14:15:23.934257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:23.934265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:23.934280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2526 reason: error at write: Disconnected sessionId: src_id|348264da-701493c9-de6aeb69-583b6d54_0
2025-10-01T14:15:23.934486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2526 sessionId: src_id|348264da-701493c9-de6aeb69-583b6d54_0 is DEAD
2025-10-01T14:15:23.934633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:23.934644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Write session will restart in 0.005927s
2025-10-01T14:15:23.934671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Write session: Do CDS request
2025-10-01T14:15:23.934678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:23.941821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.941942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:23.941958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2527
2025-10-01T14:15:23.942185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:23.942215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:23.942224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:23.942227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:23.942620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2527 sessionId:  describe result for acl check
2025-10-01T14:15:23.942653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:23.942655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:23.942656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:23.942662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256755295369132:2873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:23.943132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256755295369132:2873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:23.943307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:23.944617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256755295369132:2873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:23.945091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:23.945256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:23.945266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:23.945277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:23.945329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:23.945362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256752918448592:7561]
2025-10-01T14:15:23.945919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:23.946213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:23.946249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:23.946547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:23.946598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.946591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256755295369132:2873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:23.946601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256755295369132:2873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:23.946604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256755295369132:2873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:23.946603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.946604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.946612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:23.946605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.946606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.946607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.946608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.946609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.946610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.946611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.946612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.946613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.946614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.946615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.946620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.946628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.946632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.946635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.946639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.946643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.946646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.946650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.946653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.946657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.946661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.946664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.946668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.946671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.946677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.946685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:23.946690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.946695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:23.946699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.946704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:23.946708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.946713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:23.946717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.946722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:23.946726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.946730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:23.946735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.946740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:23.946744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.946749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:23.946753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.946758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:23.946761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.946766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.946771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.946777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.946787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.946797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.946802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.946811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:23.946814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.946823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:23.946862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:23.950336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:23.951072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:23.951086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:23.951088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:23.951091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:23.951098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2526 [2:7556256752918448592:7561]
2025-10-01T14:15:23.951112Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:23.951128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:23.951130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.951133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.951135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.951149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:23.951161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:23.951167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:23.951220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.951227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.951230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.951233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:23.951235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:23.951296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:23.951302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.951314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:23.951327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:23.951346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:23.951367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295369172:2873], now have 1 active actors on pipe
2025-10-01T14:15:23.951374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256755295369059:2446], now have 1 active actors on pipe
2025-10-01T14:15:23.951382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.951385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.951387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.951401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:23.951418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:23.951417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:23.951424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2526
2025-10-01T14:15:23.951421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:23.951423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:23.951428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2526
2025-10-01T14:15:23.951435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:23.951438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:23.951461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.951464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:23.951466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:23.951481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.951489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.951532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:23.951543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:23.951547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:23.951553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:23.951561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:23.951569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:23.951588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.951716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.951725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.951739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:23.951872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2527 partition: 0 MaxSeqNo: 45 sessionId: src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0
2025-10-01T14:15:23.952199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|348264da-701493c9-de6aeb69-583b6d54_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:23.954666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Write session: try to update token
2025-10-01T14:15:23.954684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:23.968402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId: src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:23.970784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:23.971027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:23.971052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:23.971072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:23.971077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:23.971080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:23.971086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:23.971096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.971100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.971104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256752918448587:7561]
2025-10-01T14:15:23.971145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:23.971157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:23.971159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:23.971161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:23.971165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:23.971167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:23.971323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:24.034604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256759590336484:3353]
2025-10-01T14:15:24.034852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2526, pipe: [1:7556256759590336484:3353]
2025-10-01T14:15:24.119079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:24.119443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:24.119518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336484:3353], now have 1 active actors on pipe
2025-10-01T14:15:24.119577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:24.119738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:24.119891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256759590336484:3353]
2025-10-01T14:15:24.127976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:24.129531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:24.129713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:24.129723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:24.129736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:24.129788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:24.129824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256757213416002:7556]
2025-10-01T14:15:24.130391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:24.130679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:24.130724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:24.130933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:24.130968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.130972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.130973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.130973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.130974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.130975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.130975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.130976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.130976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.130977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.130978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.130978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.130979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.130979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.130982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.130988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.130990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.130992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.130994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.130996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.130998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.131001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.131003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.131005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.131007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.131009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.131011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.131013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.131065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:24.131075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:24.131017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.131093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2527 reason: error at write: Disconnected sessionId: src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0
2025-10-01T14:15:24.131021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.131025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.131028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.131030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.131034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.131036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.131040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.131043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.131048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.131051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.131055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.131059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.131063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.131068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.131073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.131077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.131082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.131085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.131090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.131094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.131099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.131103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.131108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.131113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.131117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.131121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.131126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.131164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:24.131240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2527 sessionId: src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0 is DEAD
2025-10-01T14:15:24.131362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:24.131372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Write session will restart in 0.007014s
2025-10-01T14:15:24.131395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Write session: Do CDS request
2025-10-01T14:15:24.131402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:24.138084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:24.138833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:24.138849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:24.138850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:24.138853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:24.138858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2527 [2:7556256757213416002:7556]
2025-10-01T14:15:24.138870Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:24.138883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:24.138885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.138887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.138888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.138901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:24.138908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:24.138913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:24.138956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.138960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.138961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.138964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:24.138966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:24.139025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:24.139030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.139037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.139043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.139054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:24.139071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336498:2446], now have 1 active actors on pipe
2025-10-01T14:15:24.139081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.139085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.139086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.139094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:24.139107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:24.139108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:24.139112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:24.139114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:24.139118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:24.139121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:24.139141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.139150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:24.139157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:24.139188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2527
2025-10-01T14:15:24.139834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.139972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:24.139984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2528
2025-10-01T14:15:24.140120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.140151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:24.140161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:24.140164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:24.140550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2528 sessionId:  describe result for acl check
2025-10-01T14:15:24.140586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:24.140592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:24.140594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:24.140610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256759590336585:2860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:24.141132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256759590336585:2860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:24.143252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256759590336585:2860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:24.149323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256759590336585:2860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:24.149341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256759590336585:2860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:24.149345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256759590336585:2860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:24.149354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:24.149596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336618:2860], now have 1 active actors on pipe
2025-10-01T14:15:24.149620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2527
2025-10-01T14:15:24.149688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.149699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.149725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:24.149737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.149741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.149743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:24.149754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.149769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:24.149786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.149959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.149967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.149981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.150098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2528 partition: 0 MaxSeqNo: 45 sessionId: src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0
2025-10-01T14:15:24.150510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0eeeed9-ba90de59-22a91852-da0c95e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:24.153077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Write session: try to update token
2025-10-01T14:15:24.153093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:24.164600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:24.164619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:24.164622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:24.164624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:24.164635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.164638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.164641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256757213415997:7556]
2025-10-01T14:15:24.164677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:24.164681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:24.164684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:24.164684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:24.164690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.164692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:24.164826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:24.166917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId: src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:24.169829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:24.219929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256759590336622:3353]
2025-10-01T14:15:24.220196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2527, pipe: [1:7556256759590336622:3353]
2025-10-01T14:15:24.304053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:24.304333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.304345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.304379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336622:3353], now have 1 active actors on pipe
2025-10-01T14:15:24.304591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:24.304593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:24.304611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:24.304615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:24.304637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256759590336622:3353]
2025-10-01T14:15:24.304663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2528 reason: error at write: Disconnected sessionId: src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0
2025-10-01T14:15:24.304852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2528 sessionId: src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0 is DEAD
2025-10-01T14:15:24.304994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:24.305006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Write session will restart in 0.008813s
2025-10-01T14:15:24.305035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Write session: Do CDS request
2025-10-01T14:15:24.305041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:24.313518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:24.314936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.314983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:24.314997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2529
2025-10-01T14:15:24.315036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:24.315141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.315171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:24.315180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:24.315185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:24.315274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:24.315287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:24.315299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:24.315361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:24.315403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256757213416119:7550]
2025-10-01T14:15:24.315643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2529 sessionId:  describe result for acl check
2025-10-01T14:15:24.315676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:24.315682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:24.315684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:24.315689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256759590336702:2854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:24.316004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:24.316182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256759590336702:2854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:24.316345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:24.316397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:24.316699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:24.316761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.316767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.316768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.316769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.316770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.316771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.316772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.316773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.316774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.316775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.316776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.316778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.316779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.316779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.316786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.316795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.316799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.316802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.316805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.316809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.316812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.316816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.316819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.316823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.316826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.316829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.316833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.316836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.316843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.316850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.316855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.316860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.316864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.316868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.316872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.316877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.316882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.316886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.316890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.316894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.316898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.316904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.316907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.316912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.316915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.316921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.316926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.316930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.316934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.316938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.316942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.316946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.316950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.316955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.316958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.316962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.316997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:24.317789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256759590336702:2854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:24.320183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256759590336702:2854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:24.320196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256759590336702:2854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:24.320199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256759590336702:2854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:24.320206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:24.320476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:24.321226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:24.321244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:24.321247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:24.321250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:24.321257Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2528 [2:7556256757213416119:7550]
2025-10-01T14:15:24.321272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:24.321291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:24.321298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.321302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.321304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.321319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:24.321328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:24.321338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:24.321397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.321403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.321405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.321408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:24.321411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:24.321473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:24.321479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.321490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.321503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.321519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:24.321539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336624:2446], now have 1 active actors on pipe
2025-10-01T14:15:24.321545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336741:2854], now have 1 active actors on pipe
2025-10-01T14:15:24.321552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.321558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.321559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.321575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:24.321565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2528
2025-10-01T14:15:24.321576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2528
2025-10-01T14:15:24.321592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:24.321601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:24.321604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:24.321606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:24.321608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:24.321611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:24.321670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.321675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.321689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.321701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:24.321712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:24.321727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29ffeac7-c698d085-895cf342-f210e7e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:24.321734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.321741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.321743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:24.321752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.321761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:24.321781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.321940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.321956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.321978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.322058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2529 partition: 0 MaxSeqNo: 45 sessionId: src_id|29ffeac7-c698d085-895cf342-f210e7e5_0
2025-10-01T14:15:24.322391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85682a24-73cc6502-f5e82681-84ef1bdf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|29ffeac7-c698d085-895cf342-f210e7e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:24.324868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Write session: try to update token
2025-10-01T14:15:24.324885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:24.339894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId: src_id|29ffeac7-c698d085-895cf342-f210e7e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:24.341940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:24.342345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.342367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.342444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:24.342450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:24.342454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:24.342455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:24.342461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.342464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.342467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256757213416114:7550]
2025-10-01T14:15:24.342499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:24.342509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:24.342511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:24.342514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.342515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:24.342515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:24.342623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:24.404784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256759590336748:3353]
2025-10-01T14:15:24.405049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2528, pipe: [1:7556256759590336748:3353]
2025-10-01T14:15:24.484845Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:24.485126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:24.485177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336748:3353], now have 1 active actors on pipe
2025-10-01T14:15:24.485246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:24.485340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:24.485348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:24.485411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2529 reason: error at write: Disconnected sessionId: src_id|29ffeac7-c698d085-895cf342-f210e7e5_0
2025-10-01T14:15:24.485543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2529 sessionId: src_id|29ffeac7-c698d085-895cf342-f210e7e5_0 is DEAD
2025-10-01T14:15:24.485645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:24.485653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Write session will restart in 0.009124s
2025-10-01T14:15:24.485676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Write session: Do CDS request
2025-10-01T14:15:24.485682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:24.485736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256759590336748:3353]
2025-10-01T14:15:24.485754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:24.494226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:24.495908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.496009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:24.496026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2530
2025-10-01T14:15:24.496132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.496161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:24.496172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:24.496176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:24.496223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:24.496414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:24.496423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:24.496433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:24.496486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:24.496522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256757213416236:7547]
2025-10-01T14:15:24.496507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2530 sessionId:  describe result for acl check
2025-10-01T14:15:24.496549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:24.496550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:24.496551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:24.496555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256759590336844:2818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:24.497045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256759590336844:2818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:24.497140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:24.497420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:24.497467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:24.497793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:24.497878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.497886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.497887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.497888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.497889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.497890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.497891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.497892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.497893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.497894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.497896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.497897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.497898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.497899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.497905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.497914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.497918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.497922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.497926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.497930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.497933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.497937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.497941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.497945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.497949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.497953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.497956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.497960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.497967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.497977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.497987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.497993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.498002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.498007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.498016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.498021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.498030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.498034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.498040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.498045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.498054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.498059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.498068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.498072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.498077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.498087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.498091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.498100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.498105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.498114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.498118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.498127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.498131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.498136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.498140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.498144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.498185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:24.498612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256759590336844:2818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:24.501809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256759590336844:2818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:24.501826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256759590336844:2818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:24.501828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256759590336844:2818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:24.501837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:24.501985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:24.502627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:24.502641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:24.502644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:24.502647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:24.502653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2529 [2:7556256757213416236:7547]
2025-10-01T14:15:24.502669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:24.502687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:24.502694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.502697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.502699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.502717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:24.502725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:24.502732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:24.502881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.502887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.502890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.502893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:24.502896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:24.502958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:24.502966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.502986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.503002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.503023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:24.503016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2529
2025-10-01T14:15:24.503032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2529
2025-10-01T14:15:24.503044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336885:2818], now have 1 active actors on pipe
2025-10-01T14:15:24.503052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336764:2446], now have 1 active actors on pipe
2025-10-01T14:15:24.503058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.503060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.503062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.503073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:24.503081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:24.503083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:24.503085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:24.503086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:24.503099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:24.503102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:24.503116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.503120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.503166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.503176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:24.503182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:24.503189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:24.503197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.503201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.503203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:24.503211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.503223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:24.503270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.503406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.503419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.503440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.503529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2530 partition: 0 MaxSeqNo: 45 sessionId: src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0
2025-10-01T14:15:24.503914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ffeac7-c698d085-895cf342-f210e7e5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:24.506456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Write session: try to update token
2025-10-01T14:15:24.506474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:24.520916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId: src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:24.523173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:24.523188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:24.523190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:24.523192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:24.523201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.523205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.523209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256757213416231:7547]
2025-10-01T14:15:24.523260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:24.523262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:24.523270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.523273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:24.523275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:24.523280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:24.523401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:24.523392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:24.586010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256759590336901:3353]
2025-10-01T14:15:24.586232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2529, pipe: [1:7556256759590336901:3353]
2025-10-01T14:15:24.682041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:24.682706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.682725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.682776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336901:3353], now have 1 active actors on pipe
2025-10-01T14:15:24.682970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:24.682979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:24.682982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:24.683033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256759590336901:3353]
2025-10-01T14:15:24.683043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2530 reason: error at write: Disconnected sessionId: src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0
2025-10-01T14:15:24.683045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:24.683242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2530 sessionId: src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0 is DEAD
2025-10-01T14:15:24.683381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:24.683391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Write session will restart in 0.008587s
2025-10-01T14:15:24.683416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Write session: Do CDS request
2025-10-01T14:15:24.683421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:24.691629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:24.692916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.693023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:24.693037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2531
2025-10-01T14:15:24.693106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:24.693119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.693148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:24.693157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:24.693163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:24.693273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:24.693281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:24.693291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:24.693335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:24.693379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256757213416371:7543]
2025-10-01T14:15:24.693586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2531 sessionId:  describe result for acl check
2025-10-01T14:15:24.693616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:24.693621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:24.693622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:24.693625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256759590336988:2798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:24.693911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:24.694044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256759590336988:2798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:24.694171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:24.694242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:24.694630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:24.694707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.694717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.694718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.694719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.694721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.694722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.694723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.694724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.694726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.694727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.694728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.694729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.694730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.694731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.694736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.694746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.694751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.694755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.694758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.694762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.694766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.694770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.694773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.694777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.694781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.694784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.694787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.694790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.694798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.694806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.694812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.694817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.694821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.694826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.694831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.694836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.694841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.694846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.694850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.694855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.694864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.694870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.694873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.694878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.694883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.694888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.694892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.694901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.694906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.694915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.694919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.694923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.694932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.694936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.694945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.694954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.694991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:24.696239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256759590336988:2798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:24.698958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256759590336988:2798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:24.698973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256759590336988:2798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:24.698976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256759590336988:2798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:24.698985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:24.699121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:24.700069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:24.700087Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:24.700089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:24.700093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:24.700101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2530 [2:7556256757213416371:7543]
2025-10-01T14:15:24.700121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:24.700142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:24.700149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.700153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.700155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.700174Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:24.700183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:24.700193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:24.700250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.700258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.700260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.700262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:24.700265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:24.700326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:24.700333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.700346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.700360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.700379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:24.700399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590337027:2798], now have 1 active actors on pipe
2025-10-01T14:15:24.700406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590336909:2446], now have 1 active actors on pipe
2025-10-01T14:15:24.700413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.700419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.700421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.700438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:24.700427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2530
2025-10-01T14:15:24.700455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:24.700454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2530
2025-10-01T14:15:24.700465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:24.700472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:24.700472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:24.700474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:24.700474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:24.700545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.700554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.700573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.700584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:24.700592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:24.700610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:24.700620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.700624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.700630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:24.700638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.700650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:24.700679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.700791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.700800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.700816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.700866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2531 partition: 0 MaxSeqNo: 45 sessionId: src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0
2025-10-01T14:15:24.701198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c4e763-74c31d03-1a7a9d55-aef7804e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:24.704371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Write session: try to update token
2025-10-01T14:15:24.704387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:24.719457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId: src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:24.721680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:24.723426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.723453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.723473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:24.723476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:24.723481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:24.723482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:24.723491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.723496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.723499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256757213416366:7543]
2025-10-01T14:15:24.723555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:24.723556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:24.723561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:24.723566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:24.723565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.723568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:24.723704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:24.783138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256759590337034:3353]
2025-10-01T14:15:24.783397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2530, pipe: [1:7556256759590337034:3353]
2025-10-01T14:15:24.876389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:24.876732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:24.876793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590337034:3353], now have 1 active actors on pipe
2025-10-01T14:15:24.876876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:24.876996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256759590337034:3353]
2025-10-01T14:15:24.877025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:24.886703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:24.888449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:24.888669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:24.888682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:24.888694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:24.888746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:24.888787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256757213416520:7530]
2025-10-01T14:15:24.888959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:24.888973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:24.888996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2531 reason: error at write: Disconnected sessionId: src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0
2025-10-01T14:15:24.889140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2531 sessionId: src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0 is DEAD
2025-10-01T14:15:24.889296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:24.889303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Write session will restart in 0.005978s
2025-10-01T14:15:24.889327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Write session: Do CDS request
2025-10-01T14:15:24.889332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:24.889351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:24.895691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:24.895778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:24.896314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:24.896375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.896382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.896383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.896385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.896386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.896388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.896389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.896390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.896392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.896394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.896395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.896397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.896398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.896400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.896407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.896418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.896422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.896427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.896431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.896436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.896440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.896444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.896448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.896454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.896458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.896462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.896466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.896470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.896477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.896486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:24.896492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.896498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:24.896502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.896508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:24.896513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.896518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:24.896525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.896551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:24.896557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.896562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:24.896566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.896572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:24.896576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.896582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:24.896587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.896592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:24.896601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.896606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.896615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.896620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.896629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.896634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.896642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.896648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:24.896656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.896664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:24.896713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:24.896907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.896975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:24.896989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2532
2025-10-01T14:15:24.897112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:24.897147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:24.897158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:24.897162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:24.897522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2532 sessionId:  describe result for acl check
2025-10-01T14:15:24.897557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:24.897563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:24.897565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:24.897570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256759590337125:2788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:24.898072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256759590337125:2788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:24.901028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256759590337125:2788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:24.901297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:24.901995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:24.902009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:24.902011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:24.902013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:24.902019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2531 [2:7556256757213416520:7530]
2025-10-01T14:15:24.902029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:24.902041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:24.902044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.902047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.902049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.902065Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:24.902070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:24.902076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:24.902128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.902133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.902135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.902138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:24.902140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:24.902195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:24.902200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.902208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:24.902214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:24.902222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:24.902236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590337037:2446], now have 1 active actors on pipe
2025-10-01T14:15:24.902246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.902248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.902249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.902258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:24.902270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:24.902272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:24.902279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:24.902281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:24.902282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:24.902283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:24.902292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2531
2025-10-01T14:15:24.902312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.902320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:24.902327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:24.907650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256759590337125:2788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:24.907664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256759590337125:2788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:24.907667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256759590337125:2788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:24.907675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:24.907876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590337160:2788], now have 1 active actors on pipe
2025-10-01T14:15:24.907910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2531
2025-10-01T14:15:24.907963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.907975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.908007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|447bccf3-e524f7c6-a62735bd-a5879079_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:24.908023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:24.908029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:24.908032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:24.908043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:24.908058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:24.908087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.908220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:24.908230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:24.908254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:24.908335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2532 partition: 0 MaxSeqNo: 45 sessionId: src_id|447bccf3-e524f7c6-a62735bd-a5879079_0
2025-10-01T14:15:24.908658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bdf4473-6c156f34-ed840bd3-9edba23e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|447bccf3-e524f7c6-a62735bd-a5879079_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:24.911228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Write session: try to update token
2025-10-01T14:15:24.911247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:24.925674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId: src_id|447bccf3-e524f7c6-a62735bd-a5879079_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:24.925769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:24.925789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:24.925791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:24.925794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:24.925806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.925811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.925814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256757213416515:7530]
2025-10-01T14:15:24.925863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:24.925869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:24.925875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:24.925877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:24.925877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:24.925881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:24.926015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:24.928067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:24.977179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256759590337164:3353]
2025-10-01T14:15:24.977403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2531, pipe: [1:7556256759590337164:3353]
2025-10-01T14:15:25.066672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:25.067036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.067058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.067100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256759590337164:3353], now have 1 active actors on pipe
2025-10-01T14:15:25.067307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:25.067294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:25.067331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:25.067334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:25.067344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256759590337164:3353]
2025-10-01T14:15:25.067390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2532 reason: error at write: Disconnected sessionId: src_id|447bccf3-e524f7c6-a62735bd-a5879079_0
2025-10-01T14:15:25.067565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2532 sessionId: src_id|447bccf3-e524f7c6-a62735bd-a5879079_0 is DEAD
2025-10-01T14:15:25.067678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:25.067684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Write session will restart in 0.005512s
2025-10-01T14:15:25.067707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Write session: Do CDS request
2025-10-01T14:15:25.067712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:25.073774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.073896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:25.073908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2533
2025-10-01T14:15:25.074028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.074071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:25.074083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:25.074086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:25.074509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2533 sessionId:  describe result for acl check
2025-10-01T14:15:25.074543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:25.074551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:25.074553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:25.074561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256763885304553:2770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:25.075034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256763885304553:2770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:25.076050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:25.076686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256763885304553:2770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:25.077605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:25.077832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:25.077841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:25.077849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:25.077886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:25.077915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256761508383937:7505]
2025-10-01T14:15:25.078283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:25.078557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:25.078600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:25.078827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:25.078868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.078873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.078873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.078874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.078875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.078876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.078876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.078877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.078878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.078878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.078879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.078880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.078881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.078882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.078885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.078890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.078893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.078895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.078897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.078899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.078902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.078904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.078907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.078910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.078914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.078917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.078920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.078924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.078932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.078937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.078940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.078943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.078946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.078949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.078952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.078955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.078957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.078960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.078962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.078965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.078968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.078976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.078979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.078984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.078992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.078997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.079004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.079009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.079015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.079018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.079020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.079026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.079028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.079031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.079036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.079039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.079058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:25.079123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256763885304553:2770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:25.079137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256763885304553:2770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:25.079140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256763885304553:2770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:25.079148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:25.083197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:25.083897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:25.083908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:25.083910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:25.083912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:25.083917Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2532 [2:7556256761508383937:7505]
2025-10-01T14:15:25.083928Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:25.083940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:25.083941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.083943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.083945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.083957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:25.083961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:25.083965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:25.084021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.084027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.084028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.084030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:25.084032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:25.084082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:25.084087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.084094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.084100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.084113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:25.084134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304476:2446], now have 1 active actors on pipe
2025-10-01T14:15:25.084141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304595:2770], now have 1 active actors on pipe
2025-10-01T14:15:25.084148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.084149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.084151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.084159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:25.084169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:25.084173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:25.084176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:25.084178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:25.084180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:25.084181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:25.084209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.084216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:25.084226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:25.084221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2532
2025-10-01T14:15:25.084256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2532
2025-10-01T14:15:25.084304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.084313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.084333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:25.084341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.084343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.084345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:25.084351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.084361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:25.084371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.084478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.084484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.084498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.084593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2533 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0
2025-10-01T14:15:25.084941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447bccf3-e524f7c6-a62735bd-a5879079_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:25.087232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Write session: try to update token
2025-10-01T14:15:25.087245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:25.100224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId: src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:25.102514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:25.102725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.102748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.102786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:25.102936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:25.107285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:25.107306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:25.107308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:25.107310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:25.107320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.107323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.107327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256761508383932:7505]
2025-10-01T14:15:25.107366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:25.107372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:25.107379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.107382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:25.107384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:25.107389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:25.107510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:25.167636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256763885304608:3353]
2025-10-01T14:15:25.167882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2532, pipe: [1:7556256763885304608:3353]
2025-10-01T14:15:25.250443Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:25.257930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.257954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.258087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.258139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.258199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.258252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.258748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.258757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.258814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.258863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.258913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.258969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.259098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.259104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.259156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.259203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.259253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.259300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.259339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.259346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.259395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.259445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.259496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.259542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.259579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.259584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.259657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.259728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.259778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.259826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.259873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.259878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.259946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.260030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.260092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.260167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.260225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.260232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.260296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.260354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.260420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.260484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.260528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.260543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.260610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.260669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.260731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.260792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.260836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.260840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.260908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.260968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.261027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.261087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.261140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.261145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.261212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.261269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.261330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.261391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.261435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.261439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.261494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304608:3353], now have 1 active actors on pipe
2025-10-01T14:15:25.261725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256763885304608:3353]
2025-10-01T14:15:25.261755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:25.261757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:25.261758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:25.261781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2533 reason: error at write: Disconnected sessionId: src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0
2025-10-01T14:15:25.261919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2533 sessionId: src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0 is DEAD
2025-10-01T14:15:25.262033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:25.262064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:25.262073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Write session will restart in 0.007672s
2025-10-01T14:15:25.262091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Write session: Do CDS request
2025-10-01T14:15:25.262095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:25.270800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.270867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:25.270880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2534
2025-10-01T14:15:25.270991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.271026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:25.271037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:25.271040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:25.271384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2534 sessionId:  describe result for acl check
2025-10-01T14:15:25.271417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:25.271424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:25.271425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:25.271430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256763885304692:2751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:25.271572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:25.271877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256763885304692:2751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:25.272968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:25.273128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:25.273136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:25.273146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:25.273194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:25.273227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256761508384060:7515]
2025-10-01T14:15:25.273601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:25.273843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:25.273870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:25.274057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:25.274090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.274094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.274095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.274095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.274096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.274097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.274097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.274098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.274098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.274099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.274100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.274100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.274101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.274102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.274105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.274110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.274113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.274115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.274126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256763885304692:2751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:25.274117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.274119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.274121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.274123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.274125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.274127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.274129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.274131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.274133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.274135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.274139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.274143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.274147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.274150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.274152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.274155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.274159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.274162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.274164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.274167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.274169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.274171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.274174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.274176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.274179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.274181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.274184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.274187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.274189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.274192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.274194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.274197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.274199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.274202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.274204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.274206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.274208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.274211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.274229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:25.277834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256763885304692:2751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:25.277850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256763885304692:2751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:25.277853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256763885304692:2751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:25.277862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:25.277937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:25.278869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:25.278884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:25.278885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:25.278887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:25.278892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2533 [2:7556256761508384060:7515]
2025-10-01T14:15:25.278904Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:25.278917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:25.278919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.278921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.278923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.278939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:25.278944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:25.278950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:25.279005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.279012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.279014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.279016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:25.279019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:25.279079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:25.279086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.279098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.279111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.279123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:25.279139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304611:2446], now have 1 active actors on pipe
2025-10-01T14:15:25.279145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304732:2751], now have 1 active actors on pipe
2025-10-01T14:15:25.279150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.279151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.279152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.279162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:25.279175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:25.279173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2533
2025-10-01T14:15:25.279190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2533
2025-10-01T14:15:25.279185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:25.279191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:25.279193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:25.279195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:25.279198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:25.279224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.279227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:25.279229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:25.279243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.279248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.279289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33c1a62a-778a0a6-77284050-2670d9c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:25.279296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.279301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.279302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:25.279310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.279316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:25.279331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.279621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.279633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.279655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.279753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2534 partition: 0 MaxSeqNo: 45 sessionId: src_id|33c1a62a-778a0a6-77284050-2670d9c4_0
2025-10-01T14:15:25.280075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7222f99-41ce61e1-43bcaf21-ac9447e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|33c1a62a-778a0a6-77284050-2670d9c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:25.282547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Write session: try to update token
2025-10-01T14:15:25.282562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:25.295984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId: src_id|33c1a62a-778a0a6-77284050-2670d9c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:25.298259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:25.298478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.298498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.298531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:25.298599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:25.303532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:25.303551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:25.303553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:25.303557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:25.303565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.303572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.303575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256761508384055:7515]
2025-10-01T14:15:25.303618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:25.303621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:25.303626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.303627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:25.303628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:25.303642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:25.303744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:25.361694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256763885304740:3353]
2025-10-01T14:15:25.361907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2533, pipe: [1:7556256763885304740:3353]
2025-10-01T14:15:25.444499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:25.453492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.453516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.453679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.453740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.453814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.453885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.454251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.454265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.454338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.454418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.454491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.454569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.454622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.454633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.454705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.454769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.454835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.454908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.454957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.454965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.455034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.455510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.455589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.455658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.455707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.455715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.455821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.455882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.455956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.456020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.456090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.456098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.456175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.456260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.456342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.456421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.456479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.456487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.456584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.456656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.456733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.456846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.456905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.456912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.457002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.457078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.457186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.457259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.457306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.457311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.457382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.457457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.457533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.457609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.457679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.457686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.457766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.457832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.457897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.457965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.458012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.458018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.458095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304740:3353], now have 1 active actors on pipe
2025-10-01T14:15:25.458334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:25.458350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:25.458354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:25.458406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2534 reason: error at write: Disconnected sessionId: src_id|33c1a62a-778a0a6-77284050-2670d9c4_0
2025-10-01T14:15:25.458419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256763885304740:3353]
2025-10-01T14:15:25.458628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2534 sessionId: src_id|33c1a62a-778a0a6-77284050-2670d9c4_0 is DEAD
2025-10-01T14:15:25.458764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:25.458772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Write session will restart in 0.009983s
2025-10-01T14:15:25.458747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:25.458810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Write session: Do CDS request
2025-10-01T14:15:25.458816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:25.469235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:25.469863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.469906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:25.469917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2535
2025-10-01T14:15:25.470047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.470085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:25.470094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:25.470098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:25.470445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2535 sessionId:  describe result for acl check
2025-10-01T14:15:25.470482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:25.470487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:25.470489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:25.470494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256763885304827:2739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:25.470867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:25.470955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256763885304827:2739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:25.470984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:25.470991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:25.470999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:25.471030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:25.471065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256761508384182:7513]
2025-10-01T14:15:25.471517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:25.471742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:25.471769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:25.471969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:25.472006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.472011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.472012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.472012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.472013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.472014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.472014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.472015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.472015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.472016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.472016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.472017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.472018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.472018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.472022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.472027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.472030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.472032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.472034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.472036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.472038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.472040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.472042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.472045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.472047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.472049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.472050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.472052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.472057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.472061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.472067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.472072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.472075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.472080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.472084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.472089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.472093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.472098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.472102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.472107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.472111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.472113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.472115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.472118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.472120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.472123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.472125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.472128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.472131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.472135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.472137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.472140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.472142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.472145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.472147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.472149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.472170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:25.473149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256763885304827:2739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:25.475308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256763885304827:2739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:25.475320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256763885304827:2739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:25.475322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256763885304827:2739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:25.475327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:25.475503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:25.476195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:25.476205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:25.476206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:25.476208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:25.476213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2534 [2:7556256761508384182:7513]
2025-10-01T14:15:25.476221Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:25.476231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:25.476234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.476237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.476239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.476252Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:25.476261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:25.476266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:25.476309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.476315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.476316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.476318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:25.476320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:25.476365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:25.476372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.476382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.476396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.476415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:25.476431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304864:2739], now have 1 active actors on pipe
2025-10-01T14:15:25.476437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304742:2446], now have 1 active actors on pipe
2025-10-01T14:15:25.476442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.476443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.476444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.476453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:25.476462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:25.476457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2534
2025-10-01T14:15:25.476464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:25.476473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2534
2025-10-01T14:15:25.476467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:25.476469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:25.476473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:25.476475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:25.476491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.476496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:25.476498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:25.476511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.476517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.476553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8af7214c-15b1409d-12d669db-d2431e82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:25.476561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.476564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.476565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:25.476571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.476578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:25.476588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.476687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.476694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.476706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.476759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2535 partition: 0 MaxSeqNo: 45 sessionId: src_id|8af7214c-15b1409d-12d669db-d2431e82_0
2025-10-01T14:15:25.477030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c1a62a-778a0a6-77284050-2670d9c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8af7214c-15b1409d-12d669db-d2431e82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:25.479369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Write session: try to update token
2025-10-01T14:15:25.479383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:25.491528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId: src_id|8af7214c-15b1409d-12d669db-d2431e82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:25.493673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:25.493809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.493829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.493856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:25.493908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:25.496296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:25.496311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:25.496313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:25.496314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:25.496324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.496326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.496330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256761508384176:7513]
2025-10-01T14:15:25.496367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:25.496372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.496374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:25.496374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:25.496379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:25.496382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:25.496509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:25.558815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256763885304899:3353]
2025-10-01T14:15:25.559059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2534, pipe: [1:7556256763885304899:3353]
2025-10-01T14:15:25.633984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:25.641232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.641253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.641376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.641431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.641488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.641546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.641587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.641596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.641657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.641712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.641769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.641827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.641871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.641878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.641929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.641977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.642034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.642081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.642118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.642125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.642179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.642387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.642450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.642515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.642558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.642565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.642627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.642686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.642747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.642809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.642851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.642859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.642940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.643010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.643085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.643155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.643206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.643213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.643285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.643346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.643404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.643467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.643509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.643517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.643588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.643643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.643708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.643771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.643817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.643823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.643889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.643956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.644020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.644081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.644126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.644131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.644201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:25.644264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:25.644327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:25.644392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:25.644512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:25.644518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:25.644576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304899:3353], now have 1 active actors on pipe
2025-10-01T14:15:25.644785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:25.644794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256763885304899:3353]
2025-10-01T14:15:25.644816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:25.644818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:25.644838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2535 reason: error at write: Disconnected sessionId: src_id|8af7214c-15b1409d-12d669db-d2431e82_0
2025-10-01T14:15:25.645006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2535 sessionId: src_id|8af7214c-15b1409d-12d669db-d2431e82_0 is DEAD
2025-10-01T14:15:25.645180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:25.645190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Write session will restart in 0.007660s
2025-10-01T14:15:25.645216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Write session: Do CDS request
2025-10-01T14:15:25.645222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:25.645253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:25.652602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:25.653823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.653891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:25.653906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2536
2025-10-01T14:15:25.654016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.654041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:25.654058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:25.654064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:25.654320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:25.654354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2536 sessionId:  describe result for acl check
2025-10-01T14:15:25.654394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:25.654399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:25.654400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:25.654403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256763885304991:2694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:25.654548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:25.654560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:25.654572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:25.654628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:25.654671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256761508384322:7509]
2025-10-01T14:15:25.654825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256763885304991:2694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:25.655250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:25.655531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:25.655576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:25.655802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:25.655839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.655843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.655843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.655844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.655845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.655845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.655846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.655847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.655848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.655848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.655849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.655850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.655850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.655851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.655855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.655860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.655863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.655865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.655867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.655869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.655872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.655874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.655876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.655878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.655880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.655882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.655884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.655886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.655891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.655895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.655901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.655905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.655907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.655911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.655914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.655916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.655920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.655923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.655925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.655928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.655931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.655933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.655936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.655939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.655942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.655945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.655948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.655951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.655954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.655957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.655959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.655962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.655964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.655968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.655971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.655974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.655995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:25.656683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256763885304991:2694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:25.659051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256763885304991:2694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:25.659062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256763885304991:2694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:25.659065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256763885304991:2694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:25.659070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:25.659250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:25.659834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:25.659844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:25.659846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:25.659848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:25.659853Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2535 [2:7556256761508384322:7509]
2025-10-01T14:15:25.659863Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:25.659874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:25.659876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.659878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.659879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.659888Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:25.659892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:25.659896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:25.659931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.659937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.659938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.659940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:25.659942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:25.659993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:25.660000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.660008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.660017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.660035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:25.660052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885305030:2694], now have 1 active actors on pipe
2025-10-01T14:15:25.660058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885304907:2446], now have 1 active actors on pipe
2025-10-01T14:15:25.660062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.660064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.660066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.660077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:25.660088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:25.660091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:25.660094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:25.660095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:25.660100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:25.660101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:25.660102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2535
2025-10-01T14:15:25.660119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.660124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2535
2025-10-01T14:15:25.660126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:25.660136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:25.660153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.660161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.660182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:25.660189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.660192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.660194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:25.660199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.660206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:25.660220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.660328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.660333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.660342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.660388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2536 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0
2025-10-01T14:15:25.660694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af7214c-15b1409d-12d669db-d2431e82_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:25.662844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Write session: try to update token
2025-10-01T14:15:25.662857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:25.675883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId: src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:25.678287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:25.679897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.679919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.679938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:25.679941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:25.679943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:25.679944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:25.679950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.679954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.679957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256761508384317:7509]
2025-10-01T14:15:25.679991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:25.680002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:25.680002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:25.680005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:25.680007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.680008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:25.680130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:25.745195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256763885305037:3353]
2025-10-01T14:15:25.745376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2535, pipe: [1:7556256763885305037:3353]
2025-10-01T14:15:25.813645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:25.814032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:25.814081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885305037:3353], now have 1 active actors on pipe
2025-10-01T14:15:25.814186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:25.814250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256763885305037:3353]
2025-10-01T14:15:25.814277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:25.824292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:25.825875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:25.826040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:25.826049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:25.826058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:25.826095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:25.826133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256761508384445:7501]
2025-10-01T14:15:25.826356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:25.826366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:25.826398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2536 reason: error at write: Disconnected sessionId: src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0
2025-10-01T14:15:25.826525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2536 sessionId: src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0 is DEAD
2025-10-01T14:15:25.826621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:25.826629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Write session will restart in 0.009208s
2025-10-01T14:15:25.826646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Write session: Do CDS request
2025-10-01T14:15:25.826651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:25.826689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:25.832566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:25.832622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:25.832922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:25.832967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.832974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.832975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.832976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.832977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.832978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.832978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.832979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.832980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.832981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.832981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.832982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.832983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.832983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.832988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.832995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.832997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.833000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.833003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.833005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.833008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.833010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.833013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.833015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.833018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.833020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.833022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.833025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.833031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.833037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:25.833042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.833046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:25.833049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.833052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:25.833056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.833060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:25.833063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.833066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:25.833070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.833074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:25.833077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.833080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:25.833082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.833085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:25.833088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.833091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:25.833094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.833097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.833100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.833103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.833105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.833108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.833111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.833114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:25.833117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.833120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:25.833142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:25.836844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.836880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:25.837258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:25.837271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2537
2025-10-01T14:15:25.837366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:25.837390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:25.837397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:25.837400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:25.837622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:25.837638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:25.837640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:25.837644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:25.837651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2536 [2:7556256761508384445:7501]
2025-10-01T14:15:25.837665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:25.837681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:25.837686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.837688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.837690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.837701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:25.837708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:25.837713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:25.837753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.837758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.837759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.837762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:25.837755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2537 sessionId:  describe result for acl check
2025-10-01T14:15:25.837764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:25.837790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:25.837797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:25.837799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:25.837804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256763885305130:2691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:25.837826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:25.837832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.837840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:25.837846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:25.837856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:25.837876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885305039:2446], now have 1 active actors on pipe
2025-10-01T14:15:25.837882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.837883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.837885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.837894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:25.837905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:25.837915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:25.837918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:25.837921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:25.837923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:25.837923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:25.837926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2536
2025-10-01T14:15:25.837945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.837953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:25.837955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:25.838294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256763885305130:2691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:25.840120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256763885305130:2691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:25.845057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256763885305130:2691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:25.845067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256763885305130:2691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:25.845070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256763885305130:2691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:25.845077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:25.845258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885305168:2691], now have 1 active actors on pipe
2025-10-01T14:15:25.845301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2536
2025-10-01T14:15:25.845351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.845360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.845381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:25.845394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:25.845401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:25.845402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:25.845411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:25.845425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:25.845443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.845578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.845586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.845600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:25.845670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2537 partition: 0 MaxSeqNo: 45 sessionId: src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0
2025-10-01T14:15:25.846021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c141e43-31c70f1a-46cc8ad-1c6f6dae_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:25.848658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Write session: try to update token
2025-10-01T14:15:25.848676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:25.853091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:25.853112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:25.853123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.853165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:25.853175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:25.853432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:25.853642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:25.853869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:25.854052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:25.854335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:25.854403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:25.861864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId: src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:25.863984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:25.864155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:25.864176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:25.864205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:25.864268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:25.866649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:25.866662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:25.866664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:25.866666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:25.866676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.866679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.866682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256761508384440:7501]
2025-10-01T14:15:25.866716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:25.866721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:25.866724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:25.866725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:25.866727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:25.866730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:25.866845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:25.914153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256763885305171:3353]
2025-10-01T14:15:25.914427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2536, pipe: [1:7556256763885305171:3353]
2025-10-01T14:15:26.003978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:26.010219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.010244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.010409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.010460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.010514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.010566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.010608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.010615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.010671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.010721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.010771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.010837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.010876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.010880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.010930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.010978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.011028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.011078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.011117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.011123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.011174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.011224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.011277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.011337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.011379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.011384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.011437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.011485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.011539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.011588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.011626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.011631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.011688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.011739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.011790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.011854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.011895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.011900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.011958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.012006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.012060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.012126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.012165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.012171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.012226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.012278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.012336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.012395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.012433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.012439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.012553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.012608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.012662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.012719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.012758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.012763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.012822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.012879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.012933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.012986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.013023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.013028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.013071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256763885305171:3353], now have 1 active actors on pipe
2025-10-01T14:15:26.013290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256763885305171:3353]
2025-10-01T14:15:26.013300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:26.013304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:26.013329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:26.013330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2537 reason: error at write: Disconnected sessionId: src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0
2025-10-01T14:15:26.013510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2537 sessionId: src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0 is DEAD
2025-10-01T14:15:26.013664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:26.013675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Write session will restart in 0.005552s
2025-10-01T14:15:26.013703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Write session: Do CDS request
2025-10-01T14:15:26.013709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:26.013809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:26.020786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.020894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:26.020908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2538
2025-10-01T14:15:26.021339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.021373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:26.021382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:26.021386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:26.021443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:26.021706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2538 sessionId:  describe result for acl check
2025-10-01T14:15:26.021737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:26.021756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:26.021758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:26.021762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256768180272558:2683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:26.022252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256768180272558:2683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:26.023071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:26.023222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:26.023229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:26.023237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:26.023292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:26.023321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256765803351896:7486]
2025-10-01T14:15:26.023688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:26.023877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:26.023901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:26.023934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256768180272558:2683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:26.024082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:26.024115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.024120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.024121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.024122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.024122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.024123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.024123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.024124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.024124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.024125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.024126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.024126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.024127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.024127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.024130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.024136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.024138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.024140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.024142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.024144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.024146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.024149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.024151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.024153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.024155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.024157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.024159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.024160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.024165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.024171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.024175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.024178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.024180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.024184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.024186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.024189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.024191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.024194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.024196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.024200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.024202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.024205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.024207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.024210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.024212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.024215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.024217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.024221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.024223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.024226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.024228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.024231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.024234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.024236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.024238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.024241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.024261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:26.027303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256768180272558:2683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:26.027320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256768180272558:2683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:26.027323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256768180272558:2683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:26.027331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:26.027471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:26.028030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:26.028042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:26.028043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:26.028045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:26.028050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2537 [2:7556256765803351896:7486]
2025-10-01T14:15:26.028059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:26.028069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:26.028074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.028077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.028078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.028089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:26.028092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:26.028098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:26.028133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.028138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.028139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.028141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:26.028143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:26.028195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:26.028201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.028208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.028213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.028222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:26.028233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272472:2446], now have 1 active actors on pipe
2025-10-01T14:15:26.028246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272597:2683], now have 1 active actors on pipe
2025-10-01T14:15:26.028254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.028255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.028257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.028268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:26.028279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:26.028286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:26.028289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:26.028290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:26.028290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:26.028292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:26.028285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2537
2025-10-01T14:15:26.028308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.028313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2537
2025-10-01T14:15:26.028313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:26.028316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:26.028381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.028387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.028403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be6fabce-d57f1924-6f217234-9e21a426_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:26.028410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.028413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.028414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:26.028420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.028429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:26.028440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.028581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.028590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.028606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.028682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2538 partition: 0 MaxSeqNo: 45 sessionId: src_id|be6fabce-d57f1924-6f217234-9e21a426_0
2025-10-01T14:15:26.028959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d4b2d5-a7f7112c-f5565342-51eacf96_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be6fabce-d57f1924-6f217234-9e21a426_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:26.031509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Write session: try to update token
2025-10-01T14:15:26.031524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:26.038147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:26.038170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.038179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.038215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:26.038222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:26.038393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:26.038533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.038673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.038814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.039019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:26.039062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:26.045290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId: src_id|be6fabce-d57f1924-6f217234-9e21a426_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:26.047776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:26.047994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.048016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.048066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:26.048157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:26.056249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:26.056271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.056273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:26.056275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:26.056286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.056289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.056292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256765803351891:7486]
2025-10-01T14:15:26.056331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:26.056336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:26.056337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:26.056339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:26.056342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.056344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:26.056464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:26.113301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256768180272616:3353]
2025-10-01T14:15:26.113539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2537, pipe: [1:7556256768180272616:3353]
2025-10-01T14:15:26.197566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:26.204048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.204073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.204209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.204261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.204320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.204372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.204411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.204418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.204475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.204523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.204585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.204637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.204678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.204684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.204744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.204795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.204850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.204905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.204943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.204948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.205005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.205060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.205117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.205171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.205213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.205218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.205271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.205323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.205378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.205430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.205470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.205475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.205528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.205580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.205633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.205687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.205727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.205732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.205787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.205835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.205888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.205945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.205985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.205991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.206057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.206115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.206177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.206237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.206286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.206290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.206347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.206421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.206474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.206527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.206567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.206572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.206627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.206678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.206729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.206782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.206822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.206827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.206867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272616:3353], now have 1 active actors on pipe
2025-10-01T14:15:26.207090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:26.207094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:26.207098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:26.207125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2538 reason: error at write: Disconnected sessionId: src_id|be6fabce-d57f1924-6f217234-9e21a426_0
2025-10-01T14:15:26.207128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256768180272616:3353]
2025-10-01T14:15:26.207282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2538 sessionId: src_id|be6fabce-d57f1924-6f217234-9e21a426_0 is DEAD
2025-10-01T14:15:26.207439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:26.207447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Write session will restart in 0.008425s
2025-10-01T14:15:26.207467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Write session: Do CDS request
2025-10-01T14:15:26.207472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:26.207673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:26.215712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:26.216805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.217019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:26.217032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2539
2025-10-01T14:15:26.217154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.217189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:26.217199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:26.217204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:26.217292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:26.217461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:26.217470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:26.217480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:26.217526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:26.217561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256765803352021:7485]
2025-10-01T14:15:26.217583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2539 sessionId:  describe result for acl check
2025-10-01T14:15:26.217612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:26.217616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:26.217618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:26.217623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256768180272706:2655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:26.218077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256768180272706:2655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:26.218083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:26.218294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:26.218331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:26.218622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:26.218673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.218680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.218681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.218682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.218683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.218684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.218685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.218686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.218687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.218688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.218689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.218690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.218691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.218692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.218696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.218705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.218709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.218712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.218715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.218718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.218721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.218725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.218729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.218732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.218735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.218739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.218742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.218745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.218752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.218759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.218765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.218776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.218780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.218785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.218788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.218792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.218796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.218801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.218809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.218813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.218821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.218825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.218832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.218836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.218844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.218849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.218856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.218861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.218865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.218873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.218882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.218890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.218894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.218899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.218907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.218912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.218952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:26.219718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256768180272706:2655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:26.221957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256768180272706:2655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:26.221966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256768180272706:2655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:26.221968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256768180272706:2655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:26.221973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:26.222256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:26.223161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:26.223177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:26.223179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:26.223183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:26.223189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2538 [2:7556256765803352021:7485]
2025-10-01T14:15:26.223201Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:26.223216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:26.223219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.223221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.223223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.223238Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:26.223248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:26.223254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:26.223308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.223315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.223317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.223320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:26.223323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:26.223382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:26.223391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.223398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.223403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.223412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:26.223424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272745:2655], now have 1 active actors on pipe
2025-10-01T14:15:26.223427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272619:2446], now have 1 active actors on pipe
2025-10-01T14:15:26.223432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.223433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.223435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.223445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:26.223454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:26.223458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:26.223461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:26.223463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:26.223466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:26.223468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:26.223485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.223487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:26.223490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:26.223535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2538
2025-10-01T14:15:26.223552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2538
2025-10-01T14:15:26.223600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.223609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.223630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:26.223639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.223645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.223646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:26.223653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.223663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:26.223677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.223825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.223831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.223842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.223939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2539 partition: 0 MaxSeqNo: 45 sessionId: src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0
2025-10-01T14:15:26.224240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6fabce-d57f1924-6f217234-9e21a426_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:26.226691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Write session: try to update token
2025-10-01T14:15:26.226705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:26.238782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:26.238797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.238806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.238848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:26.238850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:26.238992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:26.239118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.239244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.239373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.239552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:26.239584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:26.240687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId: src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:26.243210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:26.243454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.243477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.243512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:26.243582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:26.251376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:26.251393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.251394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:26.251396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:26.251404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.251407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.251411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256765803352016:7485]
2025-10-01T14:15:26.251447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:26.251453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.251459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:26.251458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:26.251465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:26.251469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:26.251575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:26.307361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256768180272753:3353]
2025-10-01T14:15:26.307567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2538, pipe: [1:7556256768180272753:3353]
2025-10-01T14:15:26.383132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:26.389944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.389970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.390123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.390185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.390242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.390292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.390340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.390350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.390435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.390486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.390537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.390590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.390635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.390640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.390701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.390755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.390822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.390890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.390932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.390937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.390994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.391050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.391103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.391159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.391200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.391205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.391264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.391319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.391384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.391443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.391486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.391492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.391549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.391600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.391655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.391710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.391747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.391753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.391810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.391860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.391917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.391971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.392013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.392018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.392077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.392134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.392192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.392245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.392284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.392290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.392349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.392403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.392456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.392512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.392564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.392570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.392639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:26.392709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:26.392770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:26.392827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:26.392865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:26.392871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:26.392911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272753:3353], now have 1 active actors on pipe
2025-10-01T14:15:26.393114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256768180272753:3353]
2025-10-01T14:15:26.393140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:26.393143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:26.393168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2539 reason: error at write: Disconnected sessionId: src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0
2025-10-01T14:15:26.393286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:26.393338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2539 sessionId: src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0 is DEAD
2025-10-01T14:15:26.393440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:26.393448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Write session will restart in 0.005583s
2025-10-01T14:15:26.393465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Write session: Do CDS request
2025-10-01T14:15:26.393469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:26.393692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:26.399811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.399854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:26.399867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2540
2025-10-01T14:15:26.400002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.400033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:26.400042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:26.400046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:26.400334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2540 sessionId:  describe result for acl check
2025-10-01T14:15:26.400361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:26.400365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:26.400366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:26.400369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256768180272840:2638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:26.400745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256768180272840:2638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:26.401203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:26.402444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256768180272840:2638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:26.402715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:26.402848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:26.402856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:26.402864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:26.402903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:26.402957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256765803352149:7478]
2025-10-01T14:15:26.403341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:26.403549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:26.403579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:26.403784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:26.403820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.403825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.403825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.403826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.403827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.403827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.403828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.403829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.403829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.403830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.403830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.403831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.403832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.403832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.403835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.403841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.403843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.403845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.403847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.403849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.403851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.403853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.403855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.403857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.403859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.403861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.403863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.403865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.403870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.403874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.403878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.403881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.403883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.403886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.403889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.403892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.403894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.403897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.403903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.403906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.403909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.403911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.403914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.403919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.403923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.403932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.403940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.403943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.403949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.403951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.403954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.403957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.403963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.403966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.403968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.403971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.403995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:26.404571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256768180272840:2638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:26.404583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256768180272840:2638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:26.404586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256768180272840:2638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:26.404592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:26.407294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:26.407889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:26.407902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:26.407903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:26.407906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:26.407911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2539 [2:7556256765803352149:7478]
2025-10-01T14:15:26.407926Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:26.407943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:26.407952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.407956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.407958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.407973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:26.407981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:26.407987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:26.408044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.408053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.408055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.408058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:26.408061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:26.408132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:26.408140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.408152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.408163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.408178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:26.408199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272755:2446], now have 1 active actors on pipe
2025-10-01T14:15:26.408209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272881:2638], now have 1 active actors on pipe
2025-10-01T14:15:26.408217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.408219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.408223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.408233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:26.408245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:26.408255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:26.408263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:26.408266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:26.408267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:26.408269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:26.408307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.408320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.408334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.408342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:26.408372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:26.408376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:26.408383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.408387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.408390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:26.408399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.408407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:26.408428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.408612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.408620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.408635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.409039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc1f6f0-eeaaefd0-bd07c3fc-69342389_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:26.408204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2539
2025-10-01T14:15:26.408226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2539
2025-10-01T14:15:26.408719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2540 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0
2025-10-01T14:15:26.411360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Write session: try to update token
2025-10-01T14:15:26.411376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:26.424515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId: src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:26.426854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:26.427630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.427652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.427669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:26.427672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.427674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:26.427675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:26.427682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.427686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.427689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256765803352144:7478]
2025-10-01T14:15:26.427728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:26.427735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:26.427740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:26.427740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.427741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:26.427744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:26.427874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:26.493208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256768180272890:3353]
2025-10-01T14:15:26.493424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2539, pipe: [1:7556256768180272890:3353]
2025-10-01T14:15:26.565541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:26.565993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:26.566049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272890:3353], now have 1 active actors on pipe
2025-10-01T14:15:26.566149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:26.575041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:26.575129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:26.575143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:26.575165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2540 reason: error at write: Disconnected sessionId: src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0
2025-10-01T14:15:26.575205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:26.575250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256768180272890:3353]
2025-10-01T14:15:26.575296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2540 sessionId: src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0 is DEAD
2025-10-01T14:15:26.575451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:26.575461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Write session will restart in 0.005468s
2025-10-01T14:15:26.575487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Write session: Do CDS request
2025-10-01T14:15:26.575492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:26.580756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:26.580931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:26.580940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:26.580948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:26.580986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:26.581012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256765803352284:7473]
2025-10-01T14:15:26.581481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:26.581695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:26.581726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:26.581847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.581916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:26.581927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2541
2025-10-01T14:15:26.581946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:26.581982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.581987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.581988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.581988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.581989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.581990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.581990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.581991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.581992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.581992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.581993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.581994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.581995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.581995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.581999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.582004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.582006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.582008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.582011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.582013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.582015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.582017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.582019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.582022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.582024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.582026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.582028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.582031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.582035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.582039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.582043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.582046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.582049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.582052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.582055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.582058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.582060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.582063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.582066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.582069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.582071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.582074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.582077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.582080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.582083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.582121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.582086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.582088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.582091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.582094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.582146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:26.582099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.582103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.582151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:26.582108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.582154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:26.582112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.582117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.582121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.582124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.582145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:26.582526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2541 sessionId:  describe result for acl check
2025-10-01T14:15:26.582557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:26.582563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:26.582565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:26.582569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256768180273013:2615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:26.583013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256768180273013:2615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:26.584726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256768180273013:2615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:26.585536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:26.586296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:26.586307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:26.586308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:26.586311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:26.586315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2540 [2:7556256765803352284:7473]
2025-10-01T14:15:26.586323Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:26.586336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:26.586339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.586342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.586344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.586358Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:26.586362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:26.586368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:26.586433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.586439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.586440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.586442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:26.586443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:26.586487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:26.586492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.586500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.586505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.586514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:26.586529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180272991:2446], now have 1 active actors on pipe
2025-10-01T14:15:26.586538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.586540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.586541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.586548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:26.586549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2540
2025-10-01T14:15:26.586556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:26.586557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:26.586565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:26.586565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:26.586566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:26.586567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:26.586582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.586584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:26.586586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:26.587567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256768180273013:2615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:26.587579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256768180273013:2615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:26.587582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256768180273013:2615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:26.587588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:26.587759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273048:2615], now have 1 active actors on pipe
2025-10-01T14:15:26.587806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2540
2025-10-01T14:15:26.587847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.587855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.587876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:26.587886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.587889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.587890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:26.587905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.587916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:26.587931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.588052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.588062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.588088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.588151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2541 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0
2025-10-01T14:15:26.588450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9c944-526fa95e-662ecb4c-47483a01_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:26.590996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Write session: try to update token
2025-10-01T14:15:26.591016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:26.604128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId: src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:26.606089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:26.606107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.606109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:26.606110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:26.606117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.606121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.606124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256765803352271:7473]
2025-10-01T14:15:26.606164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:26.606167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:26.606171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.606173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:26.606173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:26.606177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:26.606189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:26.606310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:26.675503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256768180273057:3353]
2025-10-01T14:15:26.675738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2540, pipe: [1:7556256768180273057:3353]
2025-10-01T14:15:26.739736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:26.739971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.739984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.740017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273057:3353], now have 1 active actors on pipe
2025-10-01T14:15:26.740195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:26.740257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256768180273057:3353]
2025-10-01T14:15:26.740274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:26.740291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:26.740342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0
2025-10-01T14:15:26.740495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2541 sessionId: src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0 is DEAD
2025-10-01T14:15:26.740644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:26.740655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Write session will restart in 0.007569s
2025-10-01T14:15:26.740681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Write session: Do CDS request
2025-10-01T14:15:26.740687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:26.749872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.750081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:26.750105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2542
2025-10-01T14:15:26.750285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.750317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:26.750328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:26.750333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:26.750899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2542 sessionId:  describe result for acl check
2025-10-01T14:15:26.750936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:26.750941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:26.750943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:26.750948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256768180273146:2605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:26.751541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256768180273146:2605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:26.753165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:26.753410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256768180273146:2605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:26.754957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:26.755136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:26.755155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:26.755166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:26.755219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:26.755284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256765803352427:7457]
2025-10-01T14:15:26.755565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256768180273146:2605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:26.755575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256768180273146:2605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:26.755578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256768180273146:2605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:26.755585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:26.755833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:26.756162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:26.756212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:26.756511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:26.756592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.756599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.756600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.756601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.756602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.756603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.756604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.756605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.756606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.756608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.756609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.756609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.756611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.756612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.756619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.756628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.756632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.756637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.756641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.756644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.756648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.756651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.756655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.756659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.756662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.756666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.756670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.756673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.756679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.756686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.756691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.756696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.756700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.756705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.756709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.756713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.756718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.756723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.756732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.756736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.756741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.756746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.756750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.756758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.756763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.756768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.756773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.756782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.756787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.756792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.756795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.756801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.756809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.756814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.756818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.756823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.756861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:26.763605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:26.764162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:26.764175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:26.764177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:26.764180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:26.764185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2541 [2:7556256765803352427:7457]
2025-10-01T14:15:26.764196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:26.764208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:26.764213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.764215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.764217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.764229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:26.764235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:26.764239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:26.764278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.764283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.764284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.764286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:26.764288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:26.764335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:26.764341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.764348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.764353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.764362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:26.764377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.764381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.764383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.764410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:26.764419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:26.764422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:26.764424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:26.764428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:26.764440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:26.764448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:26.764457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273184:2605], now have 1 active actors on pipe
2025-10-01T14:15:26.764464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273058:2446], now have 1 active actors on pipe
2025-10-01T14:15:26.764492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.764499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:26.764491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2541
2025-10-01T14:15:26.764509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:26.764608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2541
2025-10-01T14:15:26.764673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.764684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.764707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|808650e7-b06bfc0d-6d825884-d3d54970_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:26.764719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.764727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.764730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:26.764739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.764752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:26.764765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.764932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.764939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.764953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.765034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2542 partition: 0 MaxSeqNo: 45 sessionId: src_id|808650e7-b06bfc0d-6d825884-d3d54970_0
2025-10-01T14:15:26.765384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b35babf-9eb608b-5d6e584-c762d9d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|808650e7-b06bfc0d-6d825884-d3d54970_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:26.779557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Write session: try to update token
2025-10-01T14:15:26.779576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:26.788828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:26.788842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.788850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.788891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:26.788894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:26.789061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:26.789247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.789511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.789776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:26.789952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:26.789988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:26.796405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId: src_id|808650e7-b06bfc0d-6d825884-d3d54970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:26.796679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:26.796695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.796696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:26.796697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:26.796705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.796711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.796714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256765803352420:7457]
2025-10-01T14:15:26.796749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:26.796754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.796755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:26.796877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:26.796970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:26.796981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:26.796984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:26.798623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:26.840342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256768180273196:3353]
2025-10-01T14:15:26.840584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2541, pipe: [1:7556256768180273196:3353]
2025-10-01T14:15:26.935148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:26.935598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.935622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.935645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273196:3353], now have 1 active actors on pipe
2025-10-01T14:15:26.935882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:26.935885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:26.935886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:26.935889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:26.935943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256768180273196:3353]
2025-10-01T14:15:26.935944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2542 reason: error at write: Disconnected sessionId: src_id|808650e7-b06bfc0d-6d825884-d3d54970_0
2025-10-01T14:15:26.936126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2542 sessionId: src_id|808650e7-b06bfc0d-6d825884-d3d54970_0 is DEAD
2025-10-01T14:15:26.936263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:26.936273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Write session will restart in 0.008061s
2025-10-01T14:15:26.936300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Write session: Do CDS request
2025-10-01T14:15:26.936306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:26.945930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.945979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:26.945992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2543
2025-10-01T14:15:26.945991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:26.946138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:26.946168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:26.946176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:26.946179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:26.946538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2543 sessionId:  describe result for acl check
2025-10-01T14:15:26.946569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:26.946570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:26.946572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:26.946576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256768180273289:2591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:26.947044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256768180273289:2591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:26.947736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:26.947915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:26.947924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:26.947935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:26.947982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:26.948018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256765803352571:7458]
2025-10-01T14:15:26.948462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256768180273289:2591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:26.948543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:26.948796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:26.948841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:26.949123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:26.949189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.949194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.949195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.949196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.949197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.949198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.949199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.949200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.949200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.949201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.949202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.949203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.949204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.949204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.949209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.949216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.949220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.949223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.949226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.949229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.949232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.949235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.949238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.949241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.949244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.949247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.949250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.949254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.949260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.949266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:26.949271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.949276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:26.949279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.949284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:26.949292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.949297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:26.949305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.949314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:26.949322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.949330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:26.949336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.949340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:26.949343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.949346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:26.949348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.949351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:26.949353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.949356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.949359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.949361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.949363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.949366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.949368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.949371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:26.949374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.949376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:26.949396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:26.953188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:26.953281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256768180273289:2591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:26.953294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256768180273289:2591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:26.953298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256768180273289:2591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:26.953306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:26.953856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:26.953872Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:26.953875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:26.953878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:26.953884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2542 [2:7556256765803352571:7458]
2025-10-01T14:15:26.953898Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:26.953911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:26.953912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.953914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.953915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.953927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:26.953930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:26.953934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:26.953976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.953985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.953986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.953990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:26.953992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:26.954044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:26.954050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.954057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:26.954063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:26.954071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:26.954084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273328:2591], now have 1 active actors on pipe
2025-10-01T14:15:26.954090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256768180273198:2446], now have 1 active actors on pipe
2025-10-01T14:15:26.954096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.954098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.954099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.954113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:26.954120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:26.954123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:26.954125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:26.954128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:26.954141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:26.954148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:26.954143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2542
2025-10-01T14:15:26.954152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2542
2025-10-01T14:15:26.954174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.954181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:26.954183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:26.954195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.954204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.954293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b66c425b-f54da144-29241d9a-607be4ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:26.954301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:26.954304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:26.954305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:26.954312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:26.954317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:26.954329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.954491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.954500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.954513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:26.954590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2543 partition: 0 MaxSeqNo: 45 sessionId: src_id|b66c425b-f54da144-29241d9a-607be4ea_0
2025-10-01T14:15:26.954911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808650e7-b06bfc0d-6d825884-d3d54970_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b66c425b-f54da144-29241d9a-607be4ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:26.957658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Write session: try to update token
2025-10-01T14:15:26.957675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:26.973373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId: src_id|b66c425b-f54da144-29241d9a-607be4ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:26.975694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:26.976648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:26.976670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:26.976690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:26.976694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:26.976697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:26.976701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:26.976711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.976714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.976717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256765803352565:7458]
2025-10-01T14:15:26.976776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:26.976784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:26.976786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:26.976789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:26.976790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:26.976794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:26.976911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:27.035941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256772475240634:3353]
2025-10-01T14:15:27.036180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2542, pipe: [1:7556256772475240634:3353]
2025-10-01T14:15:27.112427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:27.112714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:27.112762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240634:3353], now have 1 active actors on pipe
2025-10-01T14:15:27.112853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:27.112940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:27.112996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256772475240634:3353]
2025-10-01T14:15:27.122140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:27.123422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:27.123430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:27.123446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2543 reason: error at write: Disconnected sessionId: src_id|b66c425b-f54da144-29241d9a-607be4ea_0
2025-10-01T14:15:27.123516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2543 sessionId: src_id|b66c425b-f54da144-29241d9a-607be4ea_0 is DEAD
2025-10-01T14:15:27.123611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:27.123622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Write session will restart in 0.006719s
2025-10-01T14:15:27.123644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Write session: Do CDS request
2025-10-01T14:15:27.123650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:27.126851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:27.127115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:27.127136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:27.127154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:27.127209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:27.127246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256770098320013:7449]
2025-10-01T14:15:27.127770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:27.128117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:27.128155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:27.128405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:27.128448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.128453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.128454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.128454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.128455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.128456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.128457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.128457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.128458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.128459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.128460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.128461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.128461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.128462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.128465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.128472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.128474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.128476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.128478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.128480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.128482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.128484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.128487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.128489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.128491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.128493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.128495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.128497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.128502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.128507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.128511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.128514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.128517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.128520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.128522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.128525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.128527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.128541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.128543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.128547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.128552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.128556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.128562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.128578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.128580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.128583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.128585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.128589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.128591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.128594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.128597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.128599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.128602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.128604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.128607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.128609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.128631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:27.131922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.132004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:27.132016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2544
2025-10-01T14:15:27.132178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.132205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:27.132208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:27.132215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:27.132218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:27.132617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2544 sessionId:  describe result for acl check
2025-10-01T14:15:27.132654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:27.132662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:27.132663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:27.132669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256772475240749:2567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:27.132763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:27.132775Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:27.132777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:27.132779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:27.132783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2543 [2:7556256770098320013:7449]
2025-10-01T14:15:27.132795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:27.132811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:27.132816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.132819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.132820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.132833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:27.132842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:27.132848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:27.132899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.132906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.132908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.132910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:27.132912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:27.132963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:27.132968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.132975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.132980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.132990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:27.133004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.133008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.133010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.133016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:27.133025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:27.133028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240647:2446], now have 1 active actors on pipe
2025-10-01T14:15:27.133034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:27.133035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:27.133036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:27.133047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:27.133049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:27.133053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256772475240749:2567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:27.133074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2543
2025-10-01T14:15:27.133072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.133080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:27.133089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:27.135398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256772475240749:2567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:27.140556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256772475240749:2567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:27.140569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256772475240749:2567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:27.140572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256772475240749:2567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:27.140580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:27.140805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240789:2567], now have 1 active actors on pipe
2025-10-01T14:15:27.140832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2543
2025-10-01T14:15:27.140895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.140912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.140939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:27.140956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.140967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.140970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:27.140980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.140996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:27.141015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.141156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.141170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.141191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.141259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2544 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0
2025-10-01T14:15:27.141484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66c425b-f54da144-29241d9a-607be4ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:27.144017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Write session: try to update token
2025-10-01T14:15:27.144031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:27.149314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:27.149329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.149338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.149372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:27.149374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:27.149520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:27.149656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:27.149794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:27.149911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:27.150095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:27.150131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:27.157532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId: src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:27.159692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:27.159998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.160015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.160042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:27.160099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:27.163044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:27.163061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.163063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:27.163065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:27.163078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.163082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.163085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256770098320007:7449]
2025-10-01T14:15:27.163118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:27.163127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:27.163130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:27.163133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.163134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:27.163136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:27.163258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:27.213063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256772475240799:3353]
2025-10-01T14:15:27.213293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2543, pipe: [1:7556256772475240799:3353]
2025-10-01T14:15:27.294347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:27.300912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.300936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.301063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.301113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.301168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.301230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.301271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.301279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.301338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.301385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.301438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.301487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.301522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.301527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.301576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.301623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.301668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.301724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.301763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.301768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.301818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.301865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.301911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.301956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.301997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.302001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.302049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.302093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.302141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.302187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.302228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.302236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.302291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.302339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.302397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.302446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.302482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.302487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.302536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.302583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.302645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.302717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.302974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.302981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.303030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.303077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.303124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.303172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.303216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.303220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.303280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.303354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.303404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.303456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.303499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.303505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.303559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.303639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.303686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.303737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.303782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.303789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.303825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240799:3353], now have 1 active actors on pipe
2025-10-01T14:15:27.304006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:27.304017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:27.304021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:27.304043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2544 reason: error at write: Disconnected sessionId: src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0
2025-10-01T14:15:27.304067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256772475240799:3353]
2025-10-01T14:15:27.304233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2544 sessionId: src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0 is DEAD
2025-10-01T14:15:27.304331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:27.304343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:27.304351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Write session will restart in 0.007568s
2025-10-01T14:15:27.304370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Write session: Do CDS request
2025-10-01T14:15:27.304374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:27.312395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:27.312812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.312927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:27.312937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2545
2025-10-01T14:15:27.313034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.313057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:27.313060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:27.313063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:27.313441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2545 sessionId:  describe result for acl check
2025-10-01T14:15:27.313474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:27.313480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:27.313481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:27.313490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256772475240895:2515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:27.313935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256772475240895:2515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:27.314031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:27.314207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:27.314216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:27.314224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:27.314258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:27.314287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256770098320145:7443]
2025-10-01T14:15:27.314695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:27.314930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:27.314961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:27.315185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:27.315221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.315226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.315226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.315227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.315228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.315228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.315229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.315230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.315230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.315231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.315231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.315232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.315232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.315233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.315236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.315241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.315244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.315246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.315248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.315250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.315252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.315254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.315256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.315258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.315260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.315262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.315264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.315266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.315270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.315275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.315278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.315281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.315284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.315287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.315289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.315292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.315295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.315297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.315300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.315303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.315306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.315309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.315311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.315313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.315316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.315320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.315324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.315329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.315332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.315336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.315340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.315344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.315348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.315353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.315361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.315370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.315407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:27.315964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256772475240895:2515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:27.319104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256772475240895:2515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:27.319119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256772475240895:2515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:27.319122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256772475240895:2515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:27.319130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:27.319300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:27.319869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:27.319882Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:27.319885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:27.319887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:27.319893Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2544 [2:7556256770098320145:7443]
2025-10-01T14:15:27.319906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:27.319924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:27.319931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.319934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.319936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.319951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:27.319960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:27.319965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:27.320019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.320025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.320027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.320030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:27.320032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:27.320089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:27.320096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.320107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.320118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.320133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:27.320151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240934:2515], now have 1 active actors on pipe
2025-10-01T14:15:27.320158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240802:2446], now have 1 active actors on pipe
2025-10-01T14:15:27.320158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2544
2025-10-01T14:15:27.320165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.320171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.320166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2544
2025-10-01T14:15:27.320173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.320181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:27.320186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:27.320187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:27.320188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:27.320193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:27.320206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:27.320209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:27.320227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.320235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.320261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.320269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:27.320273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:27.320279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23baa634-52c247a8-dca10226-85755e61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:27.320283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.320288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.320289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:27.320295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.320303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:27.320336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.320432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.320438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.320450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.320518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2545 partition: 0 MaxSeqNo: 45 sessionId: src_id|23baa634-52c247a8-dca10226-85755e61_0
2025-10-01T14:15:27.320806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8baa5b-55143ebe-635c550f-ed4dbd7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|23baa634-52c247a8-dca10226-85755e61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:27.323065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Write session: try to update token
2025-10-01T14:15:27.323080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:27.338644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId: src_id|23baa634-52c247a8-dca10226-85755e61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:27.340577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:27.340597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.340599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:27.340601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:27.340609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.340612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.340615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256770098320140:7443]
2025-10-01T14:15:27.340655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:27.340664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:27.340668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.340670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:27.340670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:27.340674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:27.340779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:27.340931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:27.404051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256772475240941:3353]
2025-10-01T14:15:27.404328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2544, pipe: [1:7556256772475240941:3353]
2025-10-01T14:15:27.475096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:27.475394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.475413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.475450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240941:3353], now have 1 active actors on pipe
2025-10-01T14:15:27.475604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:27.475624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:27.475635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:27.475657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256772475240941:3353]
2025-10-01T14:15:27.475678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2545 reason: error at write: Disconnected sessionId: src_id|23baa634-52c247a8-dca10226-85755e61_0
2025-10-01T14:15:27.475687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:27.475817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2545 sessionId: src_id|23baa634-52c247a8-dca10226-85755e61_0 is DEAD
2025-10-01T14:15:27.475931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:27.475940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Write session will restart in 0.009247s
2025-10-01T14:15:27.475968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Write session: Do CDS request
2025-10-01T14:15:27.475973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:27.483782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:27.485243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:27.485375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:27.485384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:27.485395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:27.485435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:27.485468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256770098320277:7429]
2025-10-01T14:15:27.485788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.485858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:27.485852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:27.485865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2546
2025-10-01T14:15:27.485960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.485981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:27.485988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:27.485991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:27.486106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:27.486137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:27.486296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2546 sessionId:  describe result for acl check
2025-10-01T14:15:27.486324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:27.486326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:27.486327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:27.486330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256772475241040:2518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:27.486345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:27.486405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.486406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.486407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.486407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.486408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.486409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.486409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.486410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.486411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.486412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.486413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.486413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.486414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.486415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.486420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.486429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.486433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.486436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.486440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.486443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.486446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.486449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.486453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.486457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.486460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.486464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.486467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.486470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.486477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.486484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.486490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.486496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.486500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.486504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.486508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.486513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.486517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.486522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.486526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.486531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.486535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.486539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.486543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.486548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.486552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.486557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.486560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.486565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.486568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.486571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.486573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.486575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.486578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.486580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.486583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.486585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.486605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:27.486728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256772475241040:2518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:27.488604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256772475241040:2518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:27.489945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:27.490714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256772475241040:2518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:27.490725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256772475241040:2518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:27.490728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256772475241040:2518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:27.490734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:27.490708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:27.490722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:27.490724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:27.490728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:27.490734Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2545 [2:7556256770098320277:7429]
2025-10-01T14:15:27.490746Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:27.490757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:27.490759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.490761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.490762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.490772Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:27.490775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:27.490780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:27.490819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.490825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.490827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.490830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:27.490832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:27.490877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:27.490882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.490889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.490906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.490920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:27.490940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475240943:2446], now have 1 active actors on pipe
2025-10-01T14:15:27.490949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241077:2518], now have 1 active actors on pipe
2025-10-01T14:15:27.490955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.490957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.490959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.490971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:27.490987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:27.490987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:27.490990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:27.490987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2545
2025-10-01T14:15:27.490991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:27.491004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:27.491007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:27.491027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.491029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:27.491039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:27.491016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2545
2025-10-01T14:15:27.491055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.491063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.491084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:27.491093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.491095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.491097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:27.491102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.491107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:27.491121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.491234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.491241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.491253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.491313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2546 partition: 0 MaxSeqNo: 45 sessionId: src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0
2025-10-01T14:15:27.491577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23baa634-52c247a8-dca10226-85755e61_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:27.493890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Write session: try to update token
2025-10-01T14:15:27.493906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:27.507609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId: src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:27.509814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:27.510591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.510616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.510635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:27.510638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.510642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:27.510644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:27.510652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.510657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.510661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256770098320272:7429]
2025-10-01T14:15:27.510708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:27.510714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:27.510721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.510723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:27.510724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:27.510728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:27.510845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:27.575611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256772475241087:3353]
2025-10-01T14:15:27.575907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2545, pipe: [1:7556256772475241087:3353]
2025-10-01T14:15:27.645924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:27.646152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:27.646191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241087:3353], now have 1 active actors on pipe
2025-10-01T14:15:27.646273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:27.646344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:27.646348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:27.646351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:27.646419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256772475241087:3353]
2025-10-01T14:15:27.646432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2546 reason: error at write: Disconnected sessionId: src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0
2025-10-01T14:15:27.646556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2546 sessionId: src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0 is DEAD
2025-10-01T14:15:27.646633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:27.646642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Write session will restart in 0.009355s
2025-10-01T14:15:27.646658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Write session: Do CDS request
2025-10-01T14:15:27.646664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:27.653875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:27.655338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:27.655606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:27.655622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:27.655637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:27.655692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:27.655734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256770098320429:7433]
2025-10-01T14:15:27.656303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:27.656570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:27.656614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:27.656837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.656893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:27.656926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:27.656936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2547
2025-10-01T14:15:27.656965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.656972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.656972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.656973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.656974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.656975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.656977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.656978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.656979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.656979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.656981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.656981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.656982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.656983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.656988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.656997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.657000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.657003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.657007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.657010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.657013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.657016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.657019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.657023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.657042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.657026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.657029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.657032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.657034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.657042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.657048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.657053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.657057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.657063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.657067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.657070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:27.657071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.657079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:27.657075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.657079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.657083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:27.657083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.657087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.657101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.657105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.657110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.657113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.657117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.657121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.657127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.657131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.657141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.657145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.657149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.657153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.657162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.657166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.657170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.657174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.657183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.657219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:27.657379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2547 sessionId:  describe result for acl check
2025-10-01T14:15:27.657405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:27.657409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:27.657410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:27.657414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256772475241214:2489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:27.657784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256772475241214:2489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:27.659636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256772475241214:2489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:27.660479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:27.661062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:27.661072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:27.661074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:27.661076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:27.661081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2546 [2:7556256770098320429:7433]
2025-10-01T14:15:27.661090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:27.661102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:27.661103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.661105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.661106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.661117Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:27.661120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:27.661123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:27.661160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.661165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.661166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.661167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:27.661169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:27.661213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:27.661218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.661225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.661231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.661240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:27.661255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241116:2446], now have 1 active actors on pipe
2025-10-01T14:15:27.661263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.661264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.661265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.661274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:27.661282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:27.661289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:27.661292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:27.661293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:27.661294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:27.661296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:27.661293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2546
2025-10-01T14:15:27.661311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.661316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:27.661318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:27.661540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256772475241214:2489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:27.661549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256772475241214:2489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:27.661552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256772475241214:2489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:27.661556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:27.661683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241253:2489], now have 1 active actors on pipe
2025-10-01T14:15:27.661704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2546
2025-10-01T14:15:27.661745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.661751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.661767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58e18e76-b89e304e-9881557-2e30299d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:27.661772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.661777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.661778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:27.661783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.661789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:27.661803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.661905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.661910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.661918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.661970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2547 partition: 0 MaxSeqNo: 45 sessionId: src_id|58e18e76-b89e304e-9881557-2e30299d_0
2025-10-01T14:15:27.662220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2913aac-db311d7f-a1bda3b7-8d33d32e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58e18e76-b89e304e-9881557-2e30299d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:27.664704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Write session: try to update token
2025-10-01T14:15:27.664719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:27.671340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:27.671355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.671362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.671399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:27.671406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:27.671553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:27.671693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:27.671820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:27.671957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:27.672135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:27.672172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:27.678352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId: src_id|58e18e76-b89e304e-9881557-2e30299d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:27.680663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:27.680829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.680847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.680874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:27.680944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:27.689634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:27.689654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.689657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:27.689662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:27.689670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.689674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.689677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256770098320424:7433]
2025-10-01T14:15:27.689710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:27.689714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:27.689717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:27.689720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:27.689726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.689728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:27.689851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:27.746601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256772475241258:3353]
2025-10-01T14:15:27.746839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2546, pipe: [1:7556256772475241258:3353]
2025-10-01T14:15:27.825310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:27.832156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.832182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.832310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.832360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.832415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.832467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.832511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.832521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.832585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.832636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.832690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.832743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.832781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.832787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.832855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.832911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.832965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.833019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.833057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.833064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.833123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.833177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.833231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.833284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.833325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.833330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.833385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.833436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.833488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.833540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.833579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.833584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.833640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.833691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.833744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.833797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.833836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.833841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.833899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.833949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.834003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.834057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.834094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.834099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.834160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.834221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.834285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.834342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.834394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.834399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.834456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.834507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.834563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.834617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.834874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.834881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.834946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:27.835000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:27.835053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:27.835106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:27.835143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:27.835149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:27.835189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241258:3353], now have 1 active actors on pipe
2025-10-01T14:15:27.835450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256772475241258:3353]
2025-10-01T14:15:27.835452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:27.835455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:27.835480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:27.835481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2547 reason: error at write: Disconnected sessionId: src_id|58e18e76-b89e304e-9881557-2e30299d_0
2025-10-01T14:15:27.835681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2547 sessionId: src_id|58e18e76-b89e304e-9881557-2e30299d_0 is DEAD
2025-10-01T14:15:27.835770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:27.835780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Write session will restart in 0.008196s
2025-10-01T14:15:27.835804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Write session: Do CDS request
2025-10-01T14:15:27.835809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:27.836050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:27.844032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:27.844921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.845042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:27.845055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2548
2025-10-01T14:15:27.845199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:27.845232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:27.845242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:27.845245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:27.845642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2548 sessionId:  describe result for acl check
2025-10-01T14:15:27.845677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:27.845683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:27.845685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:27.845690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256772475241357:2469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:27.845936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:27.846178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:27.846195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:27.846209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:27.846270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:27.846280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256772475241357:2469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:27.846307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256770098320565:7431]
2025-10-01T14:15:27.846849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:27.847196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:27.847235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:27.847452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:27.847490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.847494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.847495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.847495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.847496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.847497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.847498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.847498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.847499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.847499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.847500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.847501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.847502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.847503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.847507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.847516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.847519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.847522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.847526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.847529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.847533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.847536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.847540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.847543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.847547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.847550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.847554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.847557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.847563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.847570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:27.847575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.847580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:27.847584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.847589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:27.847593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.847597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:27.847601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.847606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:27.847610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.847613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:27.847615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.847618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:27.847621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.847624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:27.847626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.847631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:27.847633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.847636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.847638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.847641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.847643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.847646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.847648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.847651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:27.847653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.847656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:27.847677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:27.848284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256772475241357:2469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:27.851154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256772475241357:2469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:27.851164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256772475241357:2469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:27.851166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256772475241357:2469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:27.851180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:27.851152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:27.851753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:27.851769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:27.851772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:27.851775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:27.851781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2547 [2:7556256770098320565:7431]
2025-10-01T14:15:27.851795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:27.851813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:27.851819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.851823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.851825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.851839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:27.851848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:27.851854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:27.851904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.851910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.851912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.851916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:27.851918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:27.851982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:27.851991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.852002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:27.852016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:27.852034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:27.852056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241396:2469], now have 1 active actors on pipe
2025-10-01T14:15:27.852064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241261:2446], now have 1 active actors on pipe
2025-10-01T14:15:27.852058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2547
2025-10-01T14:15:27.852072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.852079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.852061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2547
2025-10-01T14:15:27.852081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.852090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:27.852102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:27.852107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:27.852112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:27.852114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:27.852121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:27.852124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:27.852165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.852173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.852185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.852196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:27.852205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:27.852223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:27.852233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:27.852241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:27.852243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:27.852251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:27.852263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:27.852293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.852446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.852453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.852467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:27.852562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2548 partition: 0 MaxSeqNo: 45 sessionId: src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0
2025-10-01T14:15:27.852864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e18e76-b89e304e-9881557-2e30299d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:27.855151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Write session: try to update token
2025-10-01T14:15:27.855165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:27.867995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId: src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:27.870317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:27.871173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:27.871192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:27.871210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:27.871212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:27.871214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:27.871215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:27.871220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.871223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.871227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256770098320560:7431]
2025-10-01T14:15:27.871269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:27.871268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:27.871274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:27.871277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:27.871278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:27.871280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:27.871394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:27.935554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256772475241403:3353]
2025-10-01T14:15:27.936432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2547, pipe: [1:7556256772475241403:3353]
2025-10-01T14:15:28.004768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:28.005031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:28.005070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256772475241403:3353], now have 1 active actors on pipe
2025-10-01T14:15:28.005140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:28.005247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:28.005291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256772475241403:3353]
2025-10-01T14:15:28.012507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:28.013514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:28.013524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:28.013544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2548 reason: error at write: Disconnected sessionId: src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0
2025-10-01T14:15:28.013645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2548 sessionId: src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0 is DEAD
2025-10-01T14:15:28.013781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:28.013789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Write session will restart in 0.005795s
2025-10-01T14:15:28.013807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Write session: Do CDS request
2025-10-01T14:15:28.013811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:28.016771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:28.016930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:28.016938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:28.016946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:28.016979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:28.017011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256774393288025:7412]
2025-10-01T14:15:28.017384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:28.017567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:28.017590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:28.017768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:28.017801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.017805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.017806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.017806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.017807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.017807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.017808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.017809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.017809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.017810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.017810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.017811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.017811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.017811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.017814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.017820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.017822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.017824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.017826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.017828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.017830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.017832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.017834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.017836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.017837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.017839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.017841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.017843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.017848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.017852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.017855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.017859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.017861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.017864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.017867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.017870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.017872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.017874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.017877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.017879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.017882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.017884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.017887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.017889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.017891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.017894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.017896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.017899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.017902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.017904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.017906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.017909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.017913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.017915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.017917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.017920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.017940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:28.020801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.020880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:28.020892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2549
2025-10-01T14:15:28.021026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.021050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:28.021054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:28.021057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:28.021321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2549 sessionId:  describe result for acl check
2025-10-01T14:15:28.021348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:28.021353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:28.021355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:28.021358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256776770208808:2464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:28.021664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:28.021764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256776770208808:2464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:28.022263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:28.022275Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:28.022277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:28.022280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:28.022287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2548 [2:7556256774393288025:7412]
2025-10-01T14:15:28.022301Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:28.022315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:28.022318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.022321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.022323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.022336Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:28.022341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:28.022350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:28.022407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.022413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.022414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.022416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:28.022417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:28.022499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:28.022505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.022516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.022526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.022546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:28.022564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770208704:2446], now have 1 active actors on pipe
2025-10-01T14:15:28.022556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2548
2025-10-01T14:15:28.022576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.022582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.022584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.022595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:28.022605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:28.022607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:28.022611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:28.022613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:28.022618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:28.022620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:28.022641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.022649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:28.022660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:28.024107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256776770208808:2464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:28.029479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256776770208808:2464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:28.029493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256776770208808:2464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:28.029497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256776770208808:2464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:28.029503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:28.029685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770208843:2464], now have 1 active actors on pipe
2025-10-01T14:15:28.029727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2548
2025-10-01T14:15:28.029770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.029781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.029801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:28.029812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.029816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.029818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:28.029827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.029842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:28.029865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.030126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.030134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.030147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.030210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2549 partition: 0 MaxSeqNo: 45 sessionId: src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0
2025-10-01T14:15:28.030521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c47304-bbd60b6d-d2b15ac6-fe06c7a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:28.032330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:28.032343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.032349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.032386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:28.032409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:28.032549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:28.032670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:28.032795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:28.032921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:28.032970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Write session: try to update token
2025-10-01T14:15:28.032986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:28.033121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:28.033151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:28.045363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId: src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:28.047697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:28.047873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.047892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.047934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:28.047999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:28.050325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:28.050341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.050343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:28.050344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:28.050352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.050355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.050358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256774393288020:7412]
2025-10-01T14:15:28.050409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:28.050415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.050413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:28.050416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:28.050418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:28.050421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:28.050534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:28.105516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256776770208858:3353]
2025-10-01T14:15:28.105765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2548, pipe: [1:7556256776770208858:3353]
2025-10-01T14:15:28.183116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:28.190930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.190959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.191125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.191188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.191249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.191312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.191356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.191369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.191446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.191500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.191553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.191622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.191665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.191670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.191732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.191786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.191845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.191906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.191947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.191955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.192020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.192075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.192131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.192188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.192228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.192235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.192294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.192349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.192403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.192457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.192499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.192509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.192581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.192634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.192686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.192739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.192777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.192784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.192842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.192893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.192959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.193038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.193085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.193092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.193151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.193208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.193263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.193319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.193359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.193365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.193423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.193477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.193536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.193590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.193643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.193649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.193709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.193759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.193818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.193878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.193924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.193929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.193988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770208858:3353], now have 1 active actors on pipe
2025-10-01T14:15:28.194214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:28.194215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:28.194219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:28.194246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2549 reason: error at write: Disconnected sessionId: src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0
2025-10-01T14:15:28.194266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256776770208858:3353]
2025-10-01T14:15:28.194458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2549 sessionId: src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0 is DEAD
2025-10-01T14:15:28.194577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:28.194588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Write session will restart in 0.009203s
2025-10-01T14:15:28.194614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Write session: Do CDS request
2025-10-01T14:15:28.194620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:28.195060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:28.203256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:28.204894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.204982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:28.204995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2550
2025-10-01T14:15:28.205022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:28.205090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.205118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:28.205127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:28.205130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:28.205187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:28.205201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:28.205212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:28.205254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:28.205282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256774393288161:7410]
2025-10-01T14:15:28.205506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2550 sessionId:  describe result for acl check
2025-10-01T14:15:28.205543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:28.205549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:28.205551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:28.205558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256776770208959:2455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:28.205817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:28.206023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:28.206057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:28.206061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256776770208959:2455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:28.206263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:28.206298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.206302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.206302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.206303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.206303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.206304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.206305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.206306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.206306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.206307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.206308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.206308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.206309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.206309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.206312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.206318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.206320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.206322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.206324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.206326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.206328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.206330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.206332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.206334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.206336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.206338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.206340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.206342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.206348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.206352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.206356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.206359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.206361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.206364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.206366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.206385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.206389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.206394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.206398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.206402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.206406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.206415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.206423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.206431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.206438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.206443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.206451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.206456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.206464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.206473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.206480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.206487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.206489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.206492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.206494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.206496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.206519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:28.207997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256776770208959:2455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:28.209912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:28.209988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256776770208959:2455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:28.210001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256776770208959:2455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:28.210007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256776770208959:2455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:28.210014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:28.210613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:28.210628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:28.210630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:28.210633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:28.210639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2549 [2:7556256774393288161:7410]
2025-10-01T14:15:28.210652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:28.210669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:28.210676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.210680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.210686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.210701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:28.210710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:28.210720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:28.210771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.210777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.210779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.210782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:28.210784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:28.210845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:28.210854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.210866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.210882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.210901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:28.210921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770208861:2446], now have 1 active actors on pipe
2025-10-01T14:15:28.210930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770208998:2455], now have 1 active actors on pipe
2025-10-01T14:15:28.210937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.210939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.210941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.210954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:28.210968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:28.210933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2549
2025-10-01T14:15:28.210941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2549
2025-10-01T14:15:28.210983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:28.210985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:28.210988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:28.210989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:28.210990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:28.211011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.211018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:28.211020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:28.211038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.211042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.211082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:28.211088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.211092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.211094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:28.211109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.211118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:28.211136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.211279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.211289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.211304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.211378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2550 partition: 0 MaxSeqNo: 45 sessionId: src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0
2025-10-01T14:15:28.211653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3bf0538-2da4a1f-5a523ff2-cae45b75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:28.213966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Write session: try to update token
2025-10-01T14:15:28.213982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:28.225904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId: src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:28.228062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:28.228250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.228268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.228298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:28.228377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:28.230495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:28.230512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.230514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:28.230517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:28.230526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.230532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.230538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256774393288156:7410]
2025-10-01T14:15:28.230581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:28.230588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:28.230592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.230594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:28.230595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:28.230597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:28.230739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:28.294459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256776770209005:3353]
2025-10-01T14:15:28.294756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2549, pipe: [1:7556256776770209005:3353]
2025-10-01T14:15:28.369618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:28.376438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.376464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.376635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.376697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.376762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.376823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.376867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.376876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.376937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.376992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.377049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.377118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.377160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.377166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.377223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.377276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.377343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.377398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.377438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.377444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.377500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.377556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.377608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.377664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.377704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.377710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.377764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.377811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.377863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.377917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.377981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.377984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.378046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.378104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.378165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.378224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.378268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.378274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.378336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.378408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.378471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.378533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.378575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.378583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.378653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.378713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.378773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.378829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.378868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.378873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.378929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.378980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.379034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.379087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.379130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.379138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.379202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.379253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.379307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.379357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.379395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.379403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.379445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209005:3353], now have 1 active actors on pipe
2025-10-01T14:15:28.379664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:28.379671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:28.379677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:28.379705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2550 reason: error at write: Disconnected sessionId: src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0
2025-10-01T14:15:28.379726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256776770209005:3353]
2025-10-01T14:15:28.379884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2550 sessionId: src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0 is DEAD
2025-10-01T14:15:28.379966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:28.379975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Write session will restart in 0.009830s
2025-10-01T14:15:28.379992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Write session: Do CDS request
2025-10-01T14:15:28.379997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:28.380297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:28.388084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:28.390013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:28.390175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:28.390182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:28.390191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:28.390237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:28.390265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256774393288300:7409]
2025-10-01T14:15:28.390846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:28.390874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.390970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:28.390984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2551
2025-10-01T14:15:28.391095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.391121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:28.391131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:28.391136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:28.391112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:28.391144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:28.391345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:28.391381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.391386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.391386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.391387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.391387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.391388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.391388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.391389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.391390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.391390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.391391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.391392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.391392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.391393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.391396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.391402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.391404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.391407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.391409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.391411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.391413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.391415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.391417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.391419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.391421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.391423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.391425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.391427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.391431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.391436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.391440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.391443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.391445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.391448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.391450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.391453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.391456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.391458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.391460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.391463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.391466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.391469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.391477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.391482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.391486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.391495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.391495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2551 sessionId:  describe result for acl check
2025-10-01T14:15:28.391500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.391508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.391512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.391517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.391520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.391525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:28.391525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.391530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:28.391534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.391532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:28.391538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.391542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.391536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256776770209110:2450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:28.391546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.391580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:28.392028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256776770209110:2450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:28.394308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256776770209110:2450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:28.395039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:28.395670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:28.395683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:28.395684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:28.395687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:28.395692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2550 [2:7556256774393288300:7409]
2025-10-01T14:15:28.395702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:28.395714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:28.395716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.395718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.395719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.395729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:28.395736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:28.395740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:28.395780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.395786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.395787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.395789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:28.395791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:28.395835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:28.395841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.395848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.395853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.395865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:28.395879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.395885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.395886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.395892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:28.395901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:28.395909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:28.395910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:28.395913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:28.395916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:28.395916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:28.395926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209008:2446], now have 1 active actors on pipe
2025-10-01T14:15:28.395946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.395952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:28.395960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:28.395975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2550
2025-10-01T14:15:28.400712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256776770209110:2450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:28.400726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256776770209110:2450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:28.400729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256776770209110:2450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:28.400737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:28.400982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2550
2025-10-01T14:15:28.400963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209150:2450], now have 1 active actors on pipe
2025-10-01T14:15:28.401028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.401039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.401064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:28.401077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.401087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.401091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:28.401102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.401121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:28.401140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.401244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.401252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.401265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.401343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2551 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0
2025-10-01T14:15:28.401670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3464d0ee-aa8035d0-b99a88c9-cfcd25ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:28.404639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Write session: try to update token
2025-10-01T14:15:28.404658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:28.407187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:28.407212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.407223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.407262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:28.407274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:28.407529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:28.407754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:28.407946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:28.408116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:28.408337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:28.408386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:28.418716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId: src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:28.420962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:28.421159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.421183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.421222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:28.421314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:28.425138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:28.425162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.425165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:28.425168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:28.425179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.425184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.425189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256774393288295:7409]
2025-10-01T14:15:28.425233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:28.425243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:28.425244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:28.425246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:28.425251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.425257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:28.425442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:28.479778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256776770209154:3353]
2025-10-01T14:15:28.480020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2550, pipe: [1:7556256776770209154:3353]
2025-10-01T14:15:28.566311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:28.573563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.573595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.573751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.573809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.573872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.573934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.573981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.573990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.574056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.574110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.574161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.574220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.574267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.574272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.574333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.574413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.574473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.574534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.574574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.574579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.574645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.574746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.574806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.574865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.574906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.574912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.574971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.575030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.575089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.575148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.575187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.575193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.575255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.575314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.575371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.575430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.575477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.575484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.575543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.575596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.575659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.575718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.575758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.575765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.575827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.575883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.575940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.575996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.576036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.576041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.576103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.576157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.576214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.576274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.576321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.576326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.576385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.576436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.576488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.576553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.576642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.576648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.576694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209154:3353], now have 1 active actors on pipe
2025-10-01T14:15:28.576998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:28.577039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256776770209154:3353]
2025-10-01T14:15:28.577050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:28.577052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:28.577079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2551 reason: error at write: Disconnected sessionId: src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0
2025-10-01T14:15:28.577260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2551 sessionId: src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0 is DEAD
2025-10-01T14:15:28.577413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:28.577429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Write session will restart in 0.006230s
2025-10-01T14:15:28.577448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Write session: Do CDS request
2025-10-01T14:15:28.577453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:28.577806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:28.584886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.584976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:28.584989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2552
2025-10-01T14:15:28.585096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.585117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:28.585131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:28.585134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:28.585416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2552 sessionId:  describe result for acl check
2025-10-01T14:15:28.585446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:28.585450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:28.585451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:28.585454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256776770209258:2434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:28.585843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256776770209258:2434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:28.586591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:28.587810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256776770209258:2434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:28.588379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:28.588583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:28.588594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:28.588605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:28.588654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:28.588691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256774393288438:7406]
2025-10-01T14:15:28.589234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:28.589551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:28.589603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:28.589775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256776770209258:2434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:28.589784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256776770209258:2434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:28.589786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256776770209258:2434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:28.589791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:28.589914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:28.589968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.589973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.589974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.589975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.589977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.589978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.589979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.589981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.589982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.589984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.589985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.589986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.589988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.589989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.589994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.590003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.590005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.590007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.590009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.590011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.590013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.590015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.590017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.590019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.590021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.590024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.590027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.590030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.590037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.590044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.590053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.590062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.590066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.590074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.590082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.590086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.590093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.590097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.590105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.590113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.590119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.590128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.590135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.590143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.590149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.590157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.590165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.590170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.590178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.590182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.590190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.590196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.590203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.590210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.590217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.590222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.590263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:28.593604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:28.594192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:28.594206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:28.594208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:28.594211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:28.594217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2551 [2:7556256774393288438:7406]
2025-10-01T14:15:28.594232Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:28.594250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:28.594256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.594260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.594262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.594276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:28.594287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:28.594292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:28.594339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.594345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.594347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.594350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:28.594352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:28.594430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:28.594437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.594448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.594463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.594484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:28.594505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209298:2434], now have 1 active actors on pipe
2025-10-01T14:15:28.594512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209161:2446], now have 1 active actors on pipe
2025-10-01T14:15:28.594518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.594521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.594523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.594535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:28.594531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2551
2025-10-01T14:15:28.594552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:28.594553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:28.594556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:28.594540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2551
2025-10-01T14:15:28.594558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:28.594570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:28.594573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:28.594613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.594621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.594633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.594644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:28.594659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:28.594672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:28.594679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.594686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.594688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:28.594697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.594707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:28.594728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.594834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.594843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.594857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.594922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2552 partition: 0 MaxSeqNo: 45 sessionId: src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0
2025-10-01T14:15:28.595248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ca7642-1fc38e81-148eee8c-621420c5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:28.597549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Write session: try to update token
2025-10-01T14:15:28.597564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:28.610078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId: src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:28.612414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:28.612618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.612642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.612694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:28.612765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:28.615408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:28.615437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.615440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:28.615442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:28.615452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.615460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.615466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256774393288433:7406]
2025-10-01T14:15:28.615521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:28.615528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:28.615534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:28.615537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.615538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:28.615541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:28.615737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:28.677433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256776770209335:3353]
2025-10-01T14:15:28.677683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2551, pipe: [1:7556256776770209335:3353]
2025-10-01T14:15:28.761499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:28.768260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.768286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.768428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.768487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.768553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.768606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.768650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.768657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.768714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.768766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.768819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.768872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.768910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.768916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.768971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.769061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.769113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.769165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.769205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.769210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.769265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.769318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.769370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.769421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.769467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.769475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.769533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.769581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.769633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.769683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.769720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.769725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.769782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.769834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.769887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.769947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.769993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.770000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.770065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.770117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.770171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.770224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.770263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.770269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.770325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.770396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.770454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.770519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.770563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.770577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.770646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.770709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.770764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.770817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.770855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.770860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.770917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:28.770969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:28.771036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:28.771100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:28.771144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:28.771149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:28.771186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209335:3353], now have 1 active actors on pipe
2025-10-01T14:15:28.771429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256776770209335:3353]
2025-10-01T14:15:28.771445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:28.771461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:28.771463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:28.771486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2552 reason: error at write: Disconnected sessionId: src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0
2025-10-01T14:15:28.771647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2552 sessionId: src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0 is DEAD
2025-10-01T14:15:28.771744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:28.771752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Write session will restart in 0.009313s
2025-10-01T14:15:28.771799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Write session: Do CDS request
2025-10-01T14:15:28.771804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:28.772114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:28.780740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:28.781797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.781915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:28.781927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2553
2025-10-01T14:15:28.782009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.782032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:28.782035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:28.782038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:28.782342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2553 sessionId:  describe result for acl check
2025-10-01T14:15:28.782364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:28.782366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:28.782365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:28.782366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:28.782380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256776770209438:2400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:28.782533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:28.782542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:28.782550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:28.782590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:28.782620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256774393288598:7393]
2025-10-01T14:15:28.782734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256776770209438:2400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:28.783022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:28.783237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:28.783262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:28.783446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:28.783478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.783482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.783483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.783483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.783484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.783485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.783485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.783486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.783487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.783487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.783488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.783488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.783489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.783489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.783492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.783498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.783500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.783502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.783504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.783506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.783508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.783510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.783513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.783515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.783517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.783519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.783521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.783523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.783527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.783531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.783535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.783538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.783542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.783545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.783547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.783550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.783553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.783556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.783558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.783561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.783564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.783566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.783569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.783571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.783574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.783577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.783579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.783581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.783584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.783586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.783589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.783591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.783594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.783597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.783600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.783602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.783622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:28.784860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256776770209438:2400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:28.787024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:28.787049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256776770209438:2400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:28.787062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256776770209438:2400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:28.787065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256776770209438:2400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:28.787071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:28.787736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:28.787750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:28.787752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:28.787755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:28.787761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2552 [2:7556256774393288598:7393]
2025-10-01T14:15:28.787777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:28.787790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:28.787792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.787794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.787796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.787807Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:28.787811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:28.787815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:28.787851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.787858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.787860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.787864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:28.787866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:28.787929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:28.787936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.787943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.787949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.787958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:28.787974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209477:2400], now have 1 active actors on pipe
2025-10-01T14:15:28.787980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209337:2446], now have 1 active actors on pipe
2025-10-01T14:15:28.787985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.787987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.787988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.787997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:28.788010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:28.788013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:28.788016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:28.788018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:28.788021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:28.788023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:28.788042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.788048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:28.788070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.788076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.788080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:28.788035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2552
2025-10-01T14:15:28.788038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2552
2025-10-01T14:15:28.788099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:28.788107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.788110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.788112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:28.788117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.788123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:28.788133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.788233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.788238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.788247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.788297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2553 partition: 0 MaxSeqNo: 45 sessionId: src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0
2025-10-01T14:15:28.788614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca036f8-d5afc4b-e6c77858-3d4ca45a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:28.791146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Write session: try to update token
2025-10-01T14:15:28.791165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:28.806969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId: src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:28.807434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:28.807453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.807455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:28.807456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:28.807463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.807466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.807468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256774393288593:7393]
2025-10-01T14:15:28.807506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:28.807506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:28.807511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.807511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:28.807513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:28.807515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:28.807629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:28.809305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:28.871466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256776770209485:3353]
2025-10-01T14:15:28.871734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2552, pipe: [1:7556256776770209485:3353]
2025-10-01T14:15:28.943190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:28.943511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.943526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.943558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209485:3353], now have 1 active actors on pipe
2025-10-01T14:15:28.943728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:28.943765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:28.943779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:28.943790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256776770209485:3353]
2025-10-01T14:15:28.943807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:28.943830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2553 reason: error at write: Disconnected sessionId: src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0
2025-10-01T14:15:28.943989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2553 sessionId: src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0 is DEAD
2025-10-01T14:15:28.944111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:28.944122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Write session will restart in 0.006431s
2025-10-01T14:15:28.944149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Write session: Do CDS request
2025-10-01T14:15:28.944156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:28.951865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.951952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:28.951967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2554
2025-10-01T14:15:28.952064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:28.952094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:28.952106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:28.952109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:28.952449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2554 sessionId:  describe result for acl check
2025-10-01T14:15:28.952478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:28.952484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:28.952486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:28.952490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256776770209590:2401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:28.952683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:28.952954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256776770209590:2401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:28.954351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:28.954508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256776770209590:2401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:28.954530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:28.954540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:28.954550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:28.954598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:28.954636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256774393288740:7378]
2025-10-01T14:15:28.955138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:28.955418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:28.955463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:28.955751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:28.955796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.955800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.955801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.955801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.955802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.955802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.955803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.955804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.955804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.955805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.955805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.955806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.955806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.955807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.955810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.955816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.955818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.955820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.955822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.955825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.955827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.955829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.955831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.955833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.955835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.955837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.955839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.955841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.955846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.955850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:28.955854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.955857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:28.955860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.955864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:28.955868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.955873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:28.955878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.955881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:28.955886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.955890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:28.955894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.955899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:28.955903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.955906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:28.955909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.955912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:28.955915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.955918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.955926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.955928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.955930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.955933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.955939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.955942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:28.955944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.955947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:28.955967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:28.956664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256776770209590:2401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:28.956675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256776770209590:2401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:28.956677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256776770209590:2401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:28.956682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:28.959429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:28.959993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:28.960007Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:28.960009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:28.960012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:28.960017Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2553 [2:7556256774393288740:7378]
2025-10-01T14:15:28.960027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:28.960040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:28.960042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.960044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.960046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.960056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:28.960066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:28.960076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:28.960129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.960136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.960138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.960141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:28.960143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:28.960188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:28.960193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.960200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:28.960205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:28.960217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:28.960238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209627:2401], now have 1 active actors on pipe
2025-10-01T14:15:28.960246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256776770209486:2446], now have 1 active actors on pipe
2025-10-01T14:15:28.960253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.960259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.960261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.960277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:28.960291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:28.960302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2553
2025-10-01T14:15:28.960308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2553
2025-10-01T14:15:28.960304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:28.960305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:28.960308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:28.960309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:28.960311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:28.960336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.960339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:28.960352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:28.960365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.960374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.960401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:28.960410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:28.960416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:28.960418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:28.960424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:28.960435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:28.960446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.960574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:28.960580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:28.960590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:28.960652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2554 partition: 0 MaxSeqNo: 45 sessionId: src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0
2025-10-01T14:15:28.960973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa8b5ed-55f3ff29-af622af0-19d34cdc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:28.965474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Write session: try to update token
2025-10-01T14:15:28.965487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:28.978363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId: src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:28.984752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:28.984775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:28.984778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:28.984780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:28.984790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.984795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.984799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256774393288735:7378]
2025-10-01T14:15:28.984852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:28.984856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:28.984861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:28.984864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:28.984865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:28.984867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:28.985010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:28.985668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:29.044004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256781065176933:3353]
2025-10-01T14:15:29.044203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2553, pipe: [1:7556256781065176933:3353]
2025-10-01T14:15:29.129174Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:29.129593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.129606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.129641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065176933:3353], now have 1 active actors on pipe
2025-10-01T14:15:29.129986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:29.130011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256781065176933:3353]
2025-10-01T14:15:29.130031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:29.130034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:29.130036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:29.130091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2554 reason: error at write: Disconnected sessionId: src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0
2025-10-01T14:15:29.130276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2554 sessionId: src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0 is DEAD
2025-10-01T14:15:29.130416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:29.130427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Write session will restart in 0.008587s
2025-10-01T14:15:29.130455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Write session: Do CDS request
2025-10-01T14:15:29.130461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:29.139946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.140016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:29.140033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2555
2025-10-01T14:15:29.140218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.140253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:29.140262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:29.140266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:29.140686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2555 sessionId:  describe result for acl check
2025-10-01T14:15:29.140739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:29.140746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:29.140747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:29.140752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256781065177000:2386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:29.141272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256781065177000:2386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:29.143126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256781065177000:2386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:29.145022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:29.145511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256781065177000:2386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:29.145524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256781065177000:2386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:29.145527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256781065177000:2386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:29.145535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:29.147114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:29.147336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:29.147349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:29.147360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:29.147409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:29.147445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256778688256208:7373]
2025-10-01T14:15:29.147846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:29.148099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:29.148133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:29.148330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:29.148370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.148375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.148376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.148376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.148377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.148378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.148379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.148380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.148380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.148381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.148382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.148382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.148383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.148384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.148387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.148392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.148395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.148397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.148399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.148401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.148403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.148406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.148408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.148410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.148412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.148414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.148416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.148418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.148423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.148428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.148431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.148435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.148437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.148441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.148444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.148447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.148449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.148452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.148455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.148458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.148461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.148464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.148466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.148469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.148473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.148476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.148479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.148482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.148485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.148488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.148490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.148494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.148498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.148503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.148507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.148512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.148557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:29.152274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:29.153047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:29.153059Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:29.153061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:29.153063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:29.153069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2554 [2:7556256778688256208:7373]
2025-10-01T14:15:29.153079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:29.153092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:29.153098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.153100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.153102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.153113Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:29.153121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:29.153127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:29.153185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.153196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.153198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.153202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:29.153205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:29.153270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:29.153277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.153290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.153305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.153325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:29.153347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177086:2386], now have 1 active actors on pipe
2025-10-01T14:15:29.153354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065176947:2446], now have 1 active actors on pipe
2025-10-01T14:15:29.153362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.153372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.153374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.153387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:29.153402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:29.153405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:29.153405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:29.153408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:29.153418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:29.153421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:29.153419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2554
2025-10-01T14:15:29.153452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.153457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2554
2025-10-01T14:15:29.153459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:29.153473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:29.153500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.153505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.153533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:29.153546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.153550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.153552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:29.153560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.153570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:29.153582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.153708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.153715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.153731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.153840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2555 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0
2025-10-01T14:15:29.154185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152cf5b9-d84a271b-f5ad16eb-ae1a9c90_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:29.156634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Write session: try to update token
2025-10-01T14:15:29.156650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:29.171642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId: src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:29.173406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:29.173424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:29.173425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:29.173427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:29.173435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.173439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.173442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256778688256202:7373]
2025-10-01T14:15:29.173480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:29.173485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.173484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:29.173487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:29.173491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:29.173495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:29.173609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:29.174033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:29.230391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256781065177097:3353]
2025-10-01T14:15:29.230665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2554, pipe: [1:7556256781065177097:3353]
2025-10-01T14:15:29.323362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:29.323696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.323712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.323756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177097:3353], now have 1 active actors on pipe
2025-10-01T14:15:29.323974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:29.324015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:29.324023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256781065177097:3353]
2025-10-01T14:15:29.324054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:29.324124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0
2025-10-01T14:15:29.324293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2555 sessionId: src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0 is DEAD
2025-10-01T14:15:29.324444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:29.324458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Write session will restart in 0.008943s
2025-10-01T14:15:29.324486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Write session: Do CDS request
2025-10-01T14:15:29.324492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:29.333795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:29.334898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.334962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:29.334974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2556
2025-10-01T14:15:29.335076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.335106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:29.335114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:29.335118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:29.335491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2556 sessionId:  describe result for acl check
2025-10-01T14:15:29.335526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:29.335534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:29.335516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:29.335535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:29.335540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256781065177204:2371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:29.335684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:29.335696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:29.335707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:29.335756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:29.335794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256778688256350:7370]
2025-10-01T14:15:29.336031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256781065177204:2371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:29.336330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:29.336598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:29.336645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:29.336924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:29.336992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.336999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.337000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.337001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.337003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.337004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.337005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.337006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.337008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.337009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.337010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.337011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.337012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.337014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.337019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.337029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.337033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.337037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.337042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.337046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.337050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.337053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.337057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.337061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.337065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.337069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.337072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.337076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.337083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.337091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.337096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.337102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.337110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.337116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.337124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.337129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.337134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.337139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.337148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.337153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.337157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.337167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.337171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.337177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.337185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.337191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.337199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.337204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.337213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.337218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.337226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.337231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.337241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.337245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.337253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.337258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.337302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:29.337977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256781065177204:2371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:29.340457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256781065177204:2371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:29.340472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256781065177204:2371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:29.340476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256781065177204:2371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:29.340484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:29.340765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:29.341537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:29.341556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:29.341558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:29.341562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:29.341568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2555 [2:7556256778688256350:7370]
2025-10-01T14:15:29.341582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:29.341595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:29.341598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.341602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.341604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.341620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:29.341631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:29.341636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:29.341691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.341698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.341700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.341703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:29.341706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:29.341768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:29.341775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.341787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.341799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.341821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:29.341842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177100:2446], now have 1 active actors on pipe
2025-10-01T14:15:29.341851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177243:2371], now have 1 active actors on pipe
2025-10-01T14:15:29.341858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.341865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.341868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.341874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2555
2025-10-01T14:15:29.341880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2555
2025-10-01T14:15:29.341882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:29.341896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:29.341899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:29.341899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:29.341902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:29.341915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:29.341919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:29.341960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.341964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.341977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.341991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:29.342008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:29.342021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30c16316-21573973-5090bc46-f3f36e78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:29.342028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.342037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.342039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:29.342049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.342058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:29.342083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.342227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.342238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.342260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.342332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2556 partition: 0 MaxSeqNo: 45 sessionId: src_id|30c16316-21573973-5090bc46-f3f36e78_0
2025-10-01T14:15:29.342665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3394b5-316be8ee-5b0b60ad-ec273e65_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30c16316-21573973-5090bc46-f3f36e78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:29.345274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Write session: try to update token
2025-10-01T14:15:29.345290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:29.364000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:29.364034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:29.364039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:29.364042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:29.364057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.364063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.364070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256778688256345:7370]
2025-10-01T14:15:29.364128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:29.364139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:29.364144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:29.364147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:29.364158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.364161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:29.364436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:29.370423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId: src_id|30c16316-21573973-5090bc46-f3f36e78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:29.372736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:29.424406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256781065177250:3353]
2025-10-01T14:15:29.424607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2555, pipe: [1:7556256781065177250:3353]
2025-10-01T14:15:29.519368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:29.519681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.519700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.519724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177250:3353], now have 1 active actors on pipe
2025-10-01T14:15:29.519890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:29.519935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256781065177250:3353]
2025-10-01T14:15:29.519949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:29.519966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:29.520097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2556 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30c16316-21573973-5090bc46-f3f36e78_0
2025-10-01T14:15:29.520265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2556 sessionId: src_id|30c16316-21573973-5090bc46-f3f36e78_0 is DEAD
2025-10-01T14:15:29.520413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:29.520423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Write session will restart in 0.006177s
2025-10-01T14:15:29.520449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Write session: Do CDS request
2025-10-01T14:15:29.520455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:29.527876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.527954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:29.527967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2557
2025-10-01T14:15:29.528107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.528139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:29.528160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:29.528167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:29.528551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2557 sessionId:  describe result for acl check
2025-10-01T14:15:29.528580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:29.528586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:29.528588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:29.528593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256781065177355:2362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:29.528995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256781065177355:2362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:29.530545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256781065177355:2362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:29.531275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:29.533536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:29.533717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:29.533739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:29.533750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:29.533797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:29.533836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256778688256494:7366]
2025-10-01T14:15:29.533853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256781065177355:2362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:29.533868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256781065177355:2362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:29.533871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256781065177355:2362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:29.533879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:29.534404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:29.534720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:29.534765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:29.535082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:29.535154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.535159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.535160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.535161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.535162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.535164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.535165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.535167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.535168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.535169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.535171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.535172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.535173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.535175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.535180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.535190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.535194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.535197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.535201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.535205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.535209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.535213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.535217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.535223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.535227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.535235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.535239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.535246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.535253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.535263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.535270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.535276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.535285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.535290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.535298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.535304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.535312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.535321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.535326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.535334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.535339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.535345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.535353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.535358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.535365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.535371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.535379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.535385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.535394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.535402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.535408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.535416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.535424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.535429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.535436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.535442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.535482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:29.539020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:29.539623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:29.539637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:29.539639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:29.539643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:29.539649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2556 [2:7556256778688256494:7366]
2025-10-01T14:15:29.539668Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:29.539684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:29.539687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.539690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.539693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.539708Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:29.539713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:29.539724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:29.539775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.539780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.539782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.539785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:29.539789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:29.539850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:29.539856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.539868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.539883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.539902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:29.539923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177393:2362], now have 1 active actors on pipe
2025-10-01T14:15:29.539931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177253:2446], now have 1 active actors on pipe
2025-10-01T14:15:29.539938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.539941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.539943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.539954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:29.539965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:29.539968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:29.539968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:29.539970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:29.539981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:29.539988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:29.539958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2556
2025-10-01T14:15:29.539979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2556
2025-10-01T14:15:29.540015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.540022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:29.540023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:29.540037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.540041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.540083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:29.540091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.540094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.540096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:29.540105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.540115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:29.540129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.540245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.540252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.540264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.540338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2557 partition: 0 MaxSeqNo: 45 sessionId: src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0
2025-10-01T14:15:29.540675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c16316-21573973-5090bc46-f3f36e78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:29.543266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Write session: try to update token
2025-10-01T14:15:29.543282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:29.558106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId: src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:29.560450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:29.560471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:29.560474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:29.560476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:29.560486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.560491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.560495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256778688256488:7366]
2025-10-01T14:15:29.560557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:29.560568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.560571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:29.560694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:29.560753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:29.560764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:29.560766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:29.561033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:29.620024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256781065177409:3353]
2025-10-01T14:15:29.620282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2556, pipe: [1:7556256781065177409:3353]
2025-10-01T14:15:29.700972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:29.701202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.701214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.701255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177409:3353], now have 1 active actors on pipe
2025-10-01T14:15:29.701457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:29.701444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256781065177409:3353]
2025-10-01T14:15:29.701482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:29.701488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:29.701493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:29.701593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2557 reason: error at write: Disconnected sessionId: src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0
2025-10-01T14:15:29.701769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2557 sessionId: src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0 is DEAD
2025-10-01T14:15:29.701918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:29.701925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Write session will restart in 0.009551s
2025-10-01T14:15:29.701945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Write session: Do CDS request
2025-10-01T14:15:29.701950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:29.712048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:29.712933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.712974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:29.712988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2558
2025-10-01T14:15:29.713178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.713215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:29.713221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:29.713225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:29.713865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2558 sessionId:  describe result for acl check
2025-10-01T14:15:29.713906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:29.713908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:29.713909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:29.713914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256781065177546:2334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:29.714182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:29.714407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:29.714418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:29.714428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:29.714477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:29.714516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256778688256657:7361]
2025-10-01T14:15:29.714551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256781065177546:2334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:29.715091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:29.715387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:29.715438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:29.715748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:29.715797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.715803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.715804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.715805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.715806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.715807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.715808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.715809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.715810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.715811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.715812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.715813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.715814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.715815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.715820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.715828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.715831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.715834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.715838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.715841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.715844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.715848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.715851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.715855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.715859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.715862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.715867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.715869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.715874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.715878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.715882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.715885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.715887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.715890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.715893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.715896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.715898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.715901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.715904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.715906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.715909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.715912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.715914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.715917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.715919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.715923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.715925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.715928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.715931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.715933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.715936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.715940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.715944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.715949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.715953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.715957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.715993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:29.716551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256781065177546:2334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:29.719410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256781065177546:2334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:29.719421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256781065177546:2334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:29.719425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256781065177546:2334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:29.719432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:29.719654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:29.720430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:29.720444Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:29.720447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:29.720450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:29.720457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2557 [2:7556256778688256657:7361]
2025-10-01T14:15:29.720472Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:29.720490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:29.720497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.720500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.720502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.720517Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:29.720525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:29.720541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:29.720596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.720602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.720604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.720606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:29.720609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:29.720667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:29.720674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.720683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.720699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.720712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:29.720729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177439:2446], now have 1 active actors on pipe
2025-10-01T14:15:29.720732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177581:2334], now have 1 active actors on pipe
2025-10-01T14:15:29.720739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.720741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.720743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.720756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:29.720770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:29.720770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:29.720773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:29.720775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:29.720786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:29.720789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:29.720784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2557
2025-10-01T14:15:29.720804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2557
2025-10-01T14:15:29.720813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.720821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:29.720823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:29.720847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.720856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.720883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:29.720892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.720896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.720897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:29.720906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.720917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:29.720935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.721066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.721073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.721087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.721162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2558 partition: 0 MaxSeqNo: 45 sessionId: src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0
2025-10-01T14:15:29.721453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cb8c11-df41097a-bcd162d5-e6dfa349_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:29.723827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Write session: try to update token
2025-10-01T14:15:29.723841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:29.741056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:29.741080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:29.741082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:29.741084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:29.741095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.741101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.741104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256778688256651:7361]
2025-10-01T14:15:29.741153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:29.741166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.741168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:29.741174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:29.741180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:29.741186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:29.741305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:29.741947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId: src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:29.744785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:29.801765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256781065177588:3353]
2025-10-01T14:15:29.802016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2557, pipe: [1:7556256781065177588:3353]
2025-10-01T14:15:29.889889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:29.890247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.890265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.890309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177588:3353], now have 1 active actors on pipe
2025-10-01T14:15:29.890498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:29.890572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:29.890585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:29.890654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2558 reason: error at write: Disconnected sessionId: src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0
2025-10-01T14:15:29.890797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:29.890831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2558 sessionId: src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0 is DEAD
2025-10-01T14:15:29.890848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256781065177588:3353]
2025-10-01T14:15:29.890964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:29.890974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Write session will restart in 0.008827s
2025-10-01T14:15:29.891001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Write session: Do CDS request
2025-10-01T14:15:29.891006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:29.900992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.901034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:29.901049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2559
2025-10-01T14:15:29.901219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:29.901250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:29.901260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:29.901264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:29.901700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2559 sessionId:  describe result for acl check
2025-10-01T14:15:29.901737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:29.901743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:29.901744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:29.901750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256781065177697:2303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:29.902178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256781065177697:2303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:29.902899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:29.904076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256781065177697:2303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:29.905378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:29.905599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:29.905608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:29.905618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:29.905660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:29.905697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256778688256804:7358]
2025-10-01T14:15:29.906272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:29.906306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256781065177697:2303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:29.906321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256781065177697:2303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:29.906324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256781065177697:2303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:29.906332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:29.906578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:29.906637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:29.906892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:29.906951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.906957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.906958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.906959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.906960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.906961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.906961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.906962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.906963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.906964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.906964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.906965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.906966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.906967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.906970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.906977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.906979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.906981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.906984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.906986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.906988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.906991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.906993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.906995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.906998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.907000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.907002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.907004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.907009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.907014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:29.907018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.907021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:29.907023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.907029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:29.907032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.907037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:29.907041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.907046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:29.907050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.907056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:29.907061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.907066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:29.907070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.907073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:29.907076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.907079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:29.907082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.907084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.907087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.907090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.907093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.907095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.907100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.907102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:29.907105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.907108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:29.907130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:29.910886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:29.911686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:29.911698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:29.911700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:29.911703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:29.911708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2558 [2:7556256778688256804:7358]
2025-10-01T14:15:29.911718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:29.911731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:29.911736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.911739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.911740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.911752Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:29.911759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:29.911763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:29.911808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.911815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.911817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.911821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:29.911823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:29.911869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:29.911874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.911881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:29.911887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:29.911896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:29.911909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177732:2303], now have 1 active actors on pipe
2025-10-01T14:15:29.911918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.911919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.911921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.911927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:29.911935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177591:2446], now have 1 active actors on pipe
2025-10-01T14:15:29.911935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:29.911939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:29.911941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:29.911942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:29.911950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:29.911952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:29.911990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.912000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:29.912006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2558
2025-10-01T14:15:29.912034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:29.912009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2558
2025-10-01T14:15:29.912061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.912070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.912091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:29.912100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:29.912104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:29.912106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:29.912114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:29.912127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:29.912144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.912293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.912307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.912336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:29.912422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2559 partition: 0 MaxSeqNo: 45 sessionId: src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0
2025-10-01T14:15:29.912778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d303b9c-5dddf33b-51bf42cc-1a2c8d43_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:29.915521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Write session: try to update token
2025-10-01T14:15:29.915540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:29.922922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:29.922942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:29.922950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.922992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:29.922996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:29.923167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:29.923324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:29.923461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:29.923596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:29.923780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:29.923814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:29.932584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId: src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:29.935251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:29.935464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:29.935489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:29.935537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:29.935615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:29.943953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:29.943976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:29.943978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:29.943980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:29.943991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.943995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.943998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256778688256799:7358]
2025-10-01T14:15:29.944043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:29.944050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:29.944056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:29.944058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:29.944060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:29.944060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:29.944187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:29.991224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256781065177744:3353]
2025-10-01T14:15:29.991463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2558, pipe: [1:7556256781065177744:3353]
2025-10-01T14:15:30.104951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:30.112155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.112184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.112331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.112395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.112462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.112543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.112587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.112598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.112658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.112711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.112766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.112821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.112867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.112879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.112951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.113025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.113095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.113166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.113212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.113219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.113289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.113358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.113425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.113490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.113531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.113542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.113611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.113674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.113741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.113807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.113853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.113861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.113934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.114001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.114068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.114134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.114180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.114186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.114259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.114326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.114425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.114496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.114544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.114552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.114626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.114692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.114754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.114812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.114857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.114864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.114926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.114982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.115041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.115096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.115137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.115142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.115200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:30.115256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:30.115315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:30.115376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:30.115419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:30.115424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:30.115480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256781065177744:3353], now have 1 active actors on pipe
2025-10-01T14:15:30.115736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:30.115738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256781065177744:3353]
2025-10-01T14:15:30.115761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:30.115762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:30.115784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2559 reason: error at write: Disconnected sessionId: src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0
2025-10-01T14:15:30.115990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2559 sessionId: src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0 is DEAD
2025-10-01T14:15:30.116133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:30.116145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Write session will restart in 0.007378s
2025-10-01T14:15:30.116171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Write session: Do CDS request
2025-10-01T14:15:30.116177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:30.116302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:30.124896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.125000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:30.125013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2560
2025-10-01T14:15:30.125141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.125183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:30.125193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:30.125197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:30.125703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2560 sessionId:  describe result for acl check
2025-10-01T14:15:30.125736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:30.125741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:30.125743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:30.125748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256785360145164:10439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:30.126229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256785360145164:10439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:30.126949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:30.128040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256785360145164:10439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:30.129084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:30.129275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:30.129287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:30.129299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:30.129350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:30.129388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256782983224277:7338]
2025-10-01T14:15:30.129973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:30.130831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:30.130894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:30.130976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256785360145164:10439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:30.130992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256785360145164:10439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:30.130995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256785360145164:10439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:30.131004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:30.131258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:30.131333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.131340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.131342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.131343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.131344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.131345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.131346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.131347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.131349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.131350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.131351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.131352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.131353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.131354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.131361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.131371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.131375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.131379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.131382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.131386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.131390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.131394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.131398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.131402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.131405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.131408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.131412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.131415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.131422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.131430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.131441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.131451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.131456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.131465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.131470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.131479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.131483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.131490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.131493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.131496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.131500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.131510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.131518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.131524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.131535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.131540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.131551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.131556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.131568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.131578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.131589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.131599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.131613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.131624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.131632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.131637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.131695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:30.135935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:30.136884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:30.136900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:30.136903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:30.136906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:30.136913Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2559 [2:7556256782983224277:7338]
2025-10-01T14:15:30.136927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:30.136950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:30.136957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.136960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.136963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.136978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:30.136987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:30.136993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:30.137050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.137056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.137058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.137061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:30.137064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:30.137126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:30.137133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.137144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.137158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.137176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:30.137198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.137208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.137210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.137223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:30.137233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:30.137236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:30.137237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145201:10439], now have 1 active actors on pipe
2025-10-01T14:15:30.137238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:30.137240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145059:2446], now have 1 active actors on pipe
2025-10-01T14:15:30.137248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:30.137260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:30.137262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:30.137294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.137272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2559
2025-10-01T14:15:30.137286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2559
2025-10-01T14:15:30.137308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:30.137331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:30.137528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.137543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.137574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:30.137588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.137597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.137600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:30.137610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.137626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:30.137647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.137785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.137791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.137804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.137880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2560 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0
2025-10-01T14:15:30.138227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d0dfe0-4e2affb6-2b5fcbb9-d2987d10_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:30.140834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Write session: try to update token
2025-10-01T14:15:30.140851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:30.158172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId: src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:30.158574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:30.158597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:30.158599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:30.158601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:30.158611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.158615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.158622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256782983224271:7338]
2025-10-01T14:15:30.158674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:30.158687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.158690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:30.158847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:30.158855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:30.158861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:30.158868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:30.160903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:30.216010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256785360145211:3353]
2025-10-01T14:15:30.216319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2559, pipe: [1:7556256785360145211:3353]
2025-10-01T14:15:30.300868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:30.301204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.301219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.301259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145211:3353], now have 1 active actors on pipe
2025-10-01T14:15:30.301534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256785360145211:3353]
2025-10-01T14:15:30.301570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:30.301693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:30.301703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:30.301764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2560 reason: error at write: Disconnected sessionId: src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0
2025-10-01T14:15:30.301951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2560 sessionId: src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0 is DEAD
2025-10-01T14:15:30.302112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:30.302120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Write session will restart in 0.006147s
2025-10-01T14:15:30.302146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Write session: Do CDS request
2025-10-01T14:15:30.302157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:30.302196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:30.309934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.310020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:30.310037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2561
2025-10-01T14:15:30.310164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.310196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:30.310205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:30.310209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:30.310602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2561 sessionId:  describe result for acl check
2025-10-01T14:15:30.310636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:30.310642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:30.310643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:30.310648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256785360145316:10445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:30.311157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256785360145316:10445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:30.312441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:30.312977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256785360145316:10445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:30.314527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:30.314730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:30.314740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:30.314760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:30.314806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:30.314850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256782983224426:7335]
2025-10-01T14:15:30.315333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:30.315408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256785360145316:10445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:30.315422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256785360145316:10445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:30.315426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256785360145316:10445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:30.315434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:30.315531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:30.315561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:30.315802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:30.315845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.315852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.315853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.315854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.315855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.315857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.315858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.315859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.315861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.315862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.315863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.315864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.315865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.315866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.315872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.315882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.315886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.315890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.315894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.315898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.315902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.315905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.315909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.315913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.315917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.315919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.315920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.315922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.315927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.315932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.315936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.315940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.315943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.315946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.315948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.315951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.315954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.315957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.315959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.315962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.315965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.315968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.315971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.315973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.315976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.315979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.315982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.315985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.315987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.315990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.315992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.315995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.315997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.316000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.316005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.316007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.316029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:30.319633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:30.320237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:30.320252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:30.320254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:30.320257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:30.320262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2560 [2:7556256782983224426:7335]
2025-10-01T14:15:30.320274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:30.320287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:30.320289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.320291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.320293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.320305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:30.320309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:30.320314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:30.320359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.320366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.320368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.320370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:30.320372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:30.320423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:30.320429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.320436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.320445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.320463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:30.320483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145362:10445], now have 1 active actors on pipe
2025-10-01T14:15:30.320494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.320496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.320498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.320509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:30.320517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145215:2446], now have 1 active actors on pipe
2025-10-01T14:15:30.320522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:30.320536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:30.320540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:30.320542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:30.320546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:30.320548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:30.320551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2560
2025-10-01T14:15:30.320588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2560
2025-10-01T14:15:30.320578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.320590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:30.320591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:30.320628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.320638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.320658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:30.320668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.320671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.320673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:30.320680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.320687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:30.320702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.320815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.320820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.320830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.320922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2561 partition: 0 MaxSeqNo: 45 sessionId: src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0
2025-10-01T14:15:30.321223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8449c6-3e22c4cd-86b0a98a-1144fc95_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:30.323633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Write session: try to update token
2025-10-01T14:15:30.323647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:30.338240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId: src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:30.340726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:30.341384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.341410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.341432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:30.341435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:30.341438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:30.341440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:30.341448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.341453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.341457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256782983224420:7335]
2025-10-01T14:15:30.341491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:30.341496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:30.341500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:30.341516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:30.341529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.341535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:30.341671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:30.401837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256785360145371:3353]
2025-10-01T14:15:30.402118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2560, pipe: [1:7556256785360145371:3353]
2025-10-01T14:15:30.501346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:30.501856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:30.501919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145371:3353], now have 1 active actors on pipe
2025-10-01T14:15:30.502000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:30.502114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256785360145371:3353]
2025-10-01T14:15:30.502147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:30.513399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:30.514205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:30.514216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:30.514241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2561 reason: error at write: Disconnected sessionId: src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0
2025-10-01T14:15:30.514414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2561 sessionId: src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0 is DEAD
2025-10-01T14:15:30.514555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:30.514569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Write session will restart in 0.005417s
2025-10-01T14:15:30.514603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Write session: Do CDS request
2025-10-01T14:15:30.514608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:30.520978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.521020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:30.521037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2562
2025-10-01T14:15:30.521340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.521379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:30.521389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:30.521393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:30.521801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2562 sessionId:  describe result for acl check
2025-10-01T14:15:30.521837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:30.521839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:30.521840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:30.521845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256785360145487:10434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:30.521951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:30.522193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:30.522206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:30.522219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:30.522280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:30.522337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256782983224574:7333]
2025-10-01T14:15:30.522399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256785360145487:10434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:30.522949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:30.523356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:30.523417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:30.523760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:30.523825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.523832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.523833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.523834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.523835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.523836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.523837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.523839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.523840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.523841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.523842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.523843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.523844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.523846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.523851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.523862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.523865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.523869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.523873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.523877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.523881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.523885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.523889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.523893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.523897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.523901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.523905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.523909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.523916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.523924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.523929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.523935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.523939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.523945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.523954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.523959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.523968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.523974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.523983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.523988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.523998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.524003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.524011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.524016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.524021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.524031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.524035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.524041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.524050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.524055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.524064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.524069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.524076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.524081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.524085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.524090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.524132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:30.525316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256785360145487:10434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:30.528044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:30.528606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256785360145487:10434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:30.528621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256785360145487:10434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:30.528625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256785360145487:10434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:30.528647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:30.528766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:30.528782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:30.528785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:30.528788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:30.528796Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2561 [2:7556256782983224574:7333]
2025-10-01T14:15:30.528812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:30.528840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:30.528848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.528852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.528854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.528870Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:30.528875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:30.528881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:30.528939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.528945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.528948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.528951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:30.528954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:30.529018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:30.529025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.529036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.529051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.529072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:30.529099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145525:10434], now have 1 active actors on pipe
2025-10-01T14:15:30.529107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145376:2446], now have 1 active actors on pipe
2025-10-01T14:15:30.529114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.529120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.529122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.529132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2561
2025-10-01T14:15:30.529136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2561
2025-10-01T14:15:30.529134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:30.529150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:30.529162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:30.529165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:30.529206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.529207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:30.529209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:30.529210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:30.529212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:30.529218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:30.529247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.529257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.529285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:30.529297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.529301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.529303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:30.529312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.529321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:30.529334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.529519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.529533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.529556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.529643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2562 partition: 0 MaxSeqNo: 45 sessionId: src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0
2025-10-01T14:15:30.529992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ece6d7c-6b64be3-e5023e56-9e286aa1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:30.532490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Write session: try to update token
2025-10-01T14:15:30.532509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:30.547700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId: src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:30.550396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:30.551435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.551462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.551485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:30.551492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:30.551495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:30.551497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:30.551506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.551514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.551518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256782983224568:7333]
2025-10-01T14:15:30.551563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:30.551575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:30.551577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:30.551578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:30.551585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.551587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:30.551739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:30.602035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256785360145535:3353]
2025-10-01T14:15:30.602309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2561, pipe: [1:7556256785360145535:3353]
2025-10-01T14:15:30.698140Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:30.698411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:30.698470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145535:3353], now have 1 active actors on pipe
2025-10-01T14:15:30.698561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:30.710925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:30.711034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:30.711040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:30.711065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2562 reason: error at write: Disconnected sessionId: src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0
2025-10-01T14:15:30.711206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2562 sessionId: src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0 is DEAD
2025-10-01T14:15:30.711312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:30.711324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Write session will restart in 0.009406s
2025-10-01T14:15:30.711348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Write session: Do CDS request
2025-10-01T14:15:30.711354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:30.711363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256785360145535:3353]
2025-10-01T14:15:30.716710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:30.718609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:30.718776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:30.718785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:30.718793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:30.718837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:30.718864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256782983224735:7332]
2025-10-01T14:15:30.719457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:30.719753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:30.719801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:30.720044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:30.720087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.720092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.720093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.720093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.720094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.720095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.720096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.720097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.720098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.720098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.720099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.720100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.720100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.720101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.720104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.720110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.720112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.720114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.720116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.720119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.720121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.720123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.720127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.720130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.720134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.720137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.720140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.720143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.720149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.720156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.720160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.720163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.720166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.720169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.720171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.720174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.720177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.720180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.720182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.720185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.720188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.720191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.720193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.720196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.720200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.720203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.720205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.720208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.720211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.720213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.720217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.720222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.720227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.720231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.720235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.720240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.720265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:30.721975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.722213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:30.722225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2563
2025-10-01T14:15:30.722388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.722422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:30.722427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:30.722431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:30.722880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2563 sessionId:  describe result for acl check
2025-10-01T14:15:30.722909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:30.722911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:30.722912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:30.722917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256785360145674:10420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:30.723670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256785360145674:10420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:30.725459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256785360145674:10420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:30.727313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:30.727970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:30.727987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:30.727990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:30.727993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:30.727999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2562 [2:7556256782983224735:7332]
2025-10-01T14:15:30.728013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:30.728028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:30.728031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.728034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.728036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.728053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:30.728063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:30.728075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:30.728081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256785360145674:10420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:30.728094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256785360145674:10420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:30.728097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256785360145674:10420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:30.728104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:30.728128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.728135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.728136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.728139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:30.728142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:30.728238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:30.728246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.728259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.728268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.728254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2562
2025-10-01T14:15:30.728284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:30.728307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145659:2446], now have 1 active actors on pipe
2025-10-01T14:15:30.728325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.728331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.728332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.728346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:30.728359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145713:10420], now have 1 active actors on pipe
2025-10-01T14:15:30.728358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:30.728361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:30.728363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:30.728355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2562
2025-10-01T14:15:30.728369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:30.728381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:30.728388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:30.728431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.728440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.728451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.728462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:30.728476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:30.728493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5a3b5b5-7105012b-91f302d7-68448260_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:30.728504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.728512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.728514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:30.728524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.728547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:30.728570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.728696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.728705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.728720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.728781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2563 partition: 0 MaxSeqNo: 45 sessionId: src_id|f5a3b5b5-7105012b-91f302d7-68448260_0
2025-10-01T14:15:30.729091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ed11e-58bf6ba1-c2ee0b64-110f018e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f5a3b5b5-7105012b-91f302d7-68448260_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:30.731628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Write session: try to update token
2025-10-01T14:15:30.731644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:30.745820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId: src_id|f5a3b5b5-7105012b-91f302d7-68448260_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:30.748399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:30.748630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.748653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.748673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:30.748676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:30.748677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:30.748681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:30.748688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.748691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.748694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256782983224730:7332]
2025-10-01T14:15:30.748742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:30.748745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:30.748750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.748752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:30.748757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:30.748760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:30.748876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:30.811442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256785360145721:3353]
2025-10-01T14:15:30.811727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2562, pipe: [1:7556256785360145721:3353]
2025-10-01T14:15:30.903034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:30.903364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:30.903420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145721:3353], now have 1 active actors on pipe
2025-10-01T14:15:30.903567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:30.903774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256785360145721:3353]
2025-10-01T14:15:30.903804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:30.916077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:30.924918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:30.924931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:30.924958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2563 reason: error at write: Disconnected sessionId: src_id|f5a3b5b5-7105012b-91f302d7-68448260_0
2025-10-01T14:15:30.925183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2563 sessionId: src_id|f5a3b5b5-7105012b-91f302d7-68448260_0 is DEAD
2025-10-01T14:15:30.925271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:30.925283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Write session will restart in 0.008464s
2025-10-01T14:15:30.925310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Write session: Do CDS request
2025-10-01T14:15:30.925317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:30.925527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:30.925991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:30.926002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:30.926014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:30.926065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:30.926094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256782983224894:7323]
2025-10-01T14:15:30.926538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:30.926846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:30.926879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:30.927090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:30.927149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.927156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.927157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.927158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.927160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.927160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.927161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.927162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.927163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.927163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.927164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.927165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.927166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.927167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.927171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.927177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.927180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.927183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.927187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.927191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.927194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.927197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.927201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.927207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.927211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.927215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.927223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.927225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.927234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.927243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:30.927252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.927262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:30.927265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.927268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:30.927274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.927277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:30.927282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.927288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:30.927293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.927299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:30.927302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.927307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:30.927311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.927317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:30.927325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.927333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:30.927340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.927346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.927358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.927369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.927374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.927379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.927385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.927399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:30.927409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.927419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:30.927456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:30.931425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:30.932724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:30.932744Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:30.932748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:30.932752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:30.932759Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2563 [2:7556256782983224894:7323]
2025-10-01T14:15:30.932777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:30.932802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:30.932810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.932814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.932817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.932837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:30.932852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:30.932859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:30.932923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.932931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.932933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.932936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:30.932939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:30.933015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:30.933024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.933042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:30.933055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:30.933077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:30.933105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145723:2446], now have 1 active actors on pipe
2025-10-01T14:15:30.933113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.933115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.933118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.933134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:30.933153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:30.933157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:30.933160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:30.933162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:30.933173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:30.933176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:30.933218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.933214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2563
2025-10-01T14:15:30.933229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:30.933231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:30.934951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.935051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:30.935067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2564
2025-10-01T14:15:30.935181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:30.935220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:30.935226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:30.935229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:30.935668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2564 sessionId:  describe result for acl check
2025-10-01T14:15:30.935712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:30.935720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:30.935722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:30.935727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256785360145844:10418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:30.936275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256785360145844:10418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:30.939456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256785360145844:10418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:30.944157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256785360145844:10418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:30.944166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256785360145844:10418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:30.944169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256785360145844:10418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:30.944178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:30.944880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2563
2025-10-01T14:15:30.948023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256785360145879:10418], now have 1 active actors on pipe
2025-10-01T14:15:30.948068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.948079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.948102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:30.948111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:30.948120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.948176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:30.948187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:30.948194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:30.948205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:30.948208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:30.948221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:30.948245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:30.948267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:30.948479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:30.948651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:30.948812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:30.948988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:30.949220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:30.949299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.949342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:30.949614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:30.949628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:30.949650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:30.949737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2564 partition: 0 MaxSeqNo: 45 sessionId: src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0
2025-10-01T14:15:30.950160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a3b5b5-7105012b-91f302d7-68448260_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:30.953443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Write session: try to update token
2025-10-01T14:15:30.953465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:30.966639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:30.966656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:30.966658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:30.966660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:30.966668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.966671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.966674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256782983224889:7323]
2025-10-01T14:15:30.966720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:30.966722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:30.966725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:30.966726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:30.966729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:30.966744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:30.966854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:30.979616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId: src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:30.982240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:31.003954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256789655113178:3353]
2025-10-01T14:15:31.004378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2563, pipe: [1:7556256789655113178:3353]
2025-10-01T14:15:31.114636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:31.114900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.114917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.114939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113178:3353], now have 1 active actors on pipe
2025-10-01T14:15:31.115090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:31.115167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:31.115176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:31.115189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:31.115227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2564 reason: error at write: Disconnected sessionId: src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0
2025-10-01T14:15:31.115231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256789655113178:3353]
2025-10-01T14:15:31.115394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2564 sessionId: src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0 is DEAD
2025-10-01T14:15:31.115509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:31.115517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Write session will restart in 0.006719s
2025-10-01T14:15:31.115546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Write session: Do CDS request
2025-10-01T14:15:31.115551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:31.123880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.123934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:31.123962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:31.123974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2565
2025-10-01T14:15:31.124085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.124123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:31.124131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:31.124134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:31.124436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2565 sessionId:  describe result for acl check
2025-10-01T14:15:31.124462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:31.124466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:31.124467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:31.124470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256789655113307:10410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:31.124827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256789655113307:10410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:31.125825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:31.125964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:31.125974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:31.125985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:31.125996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256789655113307:10410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:31.126032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:31.126067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256787278192370:7305]
2025-10-01T14:15:31.126556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:31.126798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:31.126839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:31.127083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:31.127119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.127123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.127124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.127126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.127126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.127127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.127127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.127129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.127129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.127130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.127131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.127131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.127131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.127132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.127135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.127140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.127142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.127144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.127146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.127148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.127149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.127152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.127155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.127158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.127161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.127165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.127168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.127171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.127176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.127183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.127188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.127192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.127195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.127198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.127201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.127203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.127205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.127208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.127210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.127212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.127214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.127217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.127219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.127222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.127224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.127227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.127229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.127232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.127233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.127236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.127238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.127240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.127242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.127245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.127247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.127250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.127270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:31.127824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256789655113307:10410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:31.127834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256789655113307:10410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:31.127837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256789655113307:10410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:31.127843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:31.130623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:31.131211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:31.131224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:31.131225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:31.131228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:31.131232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2564 [2:7556256787278192370:7305]
2025-10-01T14:15:31.131242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:31.131252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:31.131254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.131257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.131258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.131269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:31.131272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:31.131276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:31.131312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.131317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.131319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.131321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:31.131322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:31.131368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:31.131372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.131380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.131385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.131394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:31.131407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.131412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.131413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.131419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:31.131428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:31.131428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:31.131431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:31.131433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:31.131439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:31.131441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:31.131449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113346:10410], now have 1 active actors on pipe
2025-10-01T14:15:31.131451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113194:2446], now have 1 active actors on pipe
2025-10-01T14:15:31.131464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.131469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:31.131479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:31.131515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2564
2025-10-01T14:15:31.131538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2564
2025-10-01T14:15:31.131566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.131575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.131598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:31.131606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.131609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.131615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:31.131622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.131629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:31.131648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.131796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.131806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.131820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.131912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2565 partition: 0 MaxSeqNo: 45 sessionId: src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0
2025-10-01T14:15:31.132184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a71de-1772049-ca9a2ebf-a0b0808b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:31.134652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Write session: try to update token
2025-10-01T14:15:31.134666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:31.149785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId: src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:31.150791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:31.150809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:31.150811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:31.150812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:31.150818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.150820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.150824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256787278192350:7305]
2025-10-01T14:15:31.150862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:31.150871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.150873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:31.150880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:31.150896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:31.150901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:31.150985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:31.152033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:31.215378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256789655113355:3353]
2025-10-01T14:15:31.215647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2564, pipe: [1:7556256789655113355:3353]
2025-10-01T14:15:31.292117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:31.292363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.292374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.292407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113355:3353], now have 1 active actors on pipe
2025-10-01T14:15:31.292620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:31.292653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:31.292663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:31.292671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:31.292715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2565 reason: error at write: Disconnected sessionId: src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0
2025-10-01T14:15:31.292715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256789655113355:3353]
2025-10-01T14:15:31.292917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2565 sessionId: src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0 is DEAD
2025-10-01T14:15:31.293077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:31.293087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Write session will restart in 0.008952s
2025-10-01T14:15:31.293115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Write session: Do CDS request
2025-10-01T14:15:31.293121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:31.302786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.302922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:31.302935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2566
2025-10-01T14:15:31.303056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.303087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:31.303094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:31.303097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:31.303240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:31.303463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2566 sessionId:  describe result for acl check
2025-10-01T14:15:31.303499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:31.303505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:31.303507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:31.303517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256789655113470:10400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:31.304037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256789655113470:10400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:31.305002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:31.305193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:31.305202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:31.305213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:31.305261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:31.305296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256787278192526:7297]
2025-10-01T14:15:31.305873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256789655113470:10400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:31.305895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:31.306140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:31.306179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:31.306503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:31.306565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.306573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.306573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.306574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.306575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.306576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.306577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.306578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.306579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.306579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.306580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.306581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.306582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.306583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.306587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.306596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.306599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.306602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.306606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.306610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.306613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.306617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.306621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.306625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.306629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.306632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.306637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.306640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.306647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.306655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.306660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.306665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.306669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.306674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.306678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.306682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.306687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.306692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.306696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.306701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.306705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.306710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.306715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.306720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.306729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.306734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.306738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.306743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.306748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.306757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.306761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.306770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.306776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.306785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.306789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.306798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.306837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:31.310220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256789655113470:10400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:31.310237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256789655113470:10400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:31.310240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256789655113470:10400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:31.310247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:31.310401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:31.311164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:31.311176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:31.311178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:31.311182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:31.311189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2565 [2:7556256787278192526:7297]
2025-10-01T14:15:31.311203Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:31.311216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:31.311223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.311226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.311228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.311243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:31.311252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:31.311258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:31.311309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.311315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.311316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.311319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:31.311322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:31.311381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:31.311387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.311398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.311413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.311432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:31.311453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113357:2446], now have 1 active actors on pipe
2025-10-01T14:15:31.311461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113511:10400], now have 1 active actors on pipe
2025-10-01T14:15:31.311468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.311478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.311480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.311489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:31.311467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2565
2025-10-01T14:15:31.311501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:31.311503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:31.311506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:31.311508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:31.311520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:31.311522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:31.311522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2565
2025-10-01T14:15:31.311552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.311562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:31.311573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:31.311576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.311580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.311622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:31.311633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.311637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.311643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:31.311651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.311663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:31.311683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.311803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.311812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.311826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.311914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2566 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0
2025-10-01T14:15:31.312252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7230b1e8-1c97dd7f-a52b78b8-b619ac73_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:31.314731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Write session: try to update token
2025-10-01T14:15:31.314748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:31.328744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId: src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:31.331198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:31.331977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.332008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.332031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:31.332035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:31.332038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:31.332040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:31.332048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.332053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.332056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256787278192520:7297]
2025-10-01T14:15:31.332107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:31.332114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:31.332121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.332123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:31.332124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:31.332129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:31.332261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:31.393058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256789655113518:3353]
2025-10-01T14:15:31.393305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2565, pipe: [1:7556256789655113518:3353]
2025-10-01T14:15:31.486870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:31.487166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:31.487220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113518:3353], now have 1 active actors on pipe
2025-10-01T14:15:31.487486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:31.487555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:31.487574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:31.487577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:31.487613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256789655113518:3353]
2025-10-01T14:15:31.487642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2566 reason: error at write: Disconnected sessionId: src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0
2025-10-01T14:15:31.487786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2566 sessionId: src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0 is DEAD
2025-10-01T14:15:31.487930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:31.487940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Write session will restart in 0.009397s
2025-10-01T14:15:31.487963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Write session: Do CDS request
2025-10-01T14:15:31.487972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:31.498459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:31.498910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.498944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:31.498958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2567
2025-10-01T14:15:31.499100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.499129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:31.499138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:31.499142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:31.499489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2567 sessionId:  describe result for acl check
2025-10-01T14:15:31.499522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:31.499530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:31.499532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:31.499536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256789655113639:10396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:31.499929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256789655113639:10396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:31.500355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:31.500535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:31.500545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:31.500555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:31.500595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:31.500636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256787278192679:7292]
2025-10-01T14:15:31.501092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:31.501434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:31.501478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:31.501769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:31.501836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.501843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.501844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.501846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.501847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.501848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.501849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.501850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.501851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.501852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.501853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.501854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.501855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.501856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.501861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.501871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.501875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.501879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.501883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.501887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.501890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.501894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.501898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.501902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.501906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.501909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.501913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.501917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.501923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.501931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.501936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.501942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.501925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256789655113639:10396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:31.501946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.501952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.501956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.501961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.501966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.501971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.501975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.501985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.501994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.502006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.502015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.502024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.502034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.502043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.502048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.502053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.502059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.502068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.502077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.502086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.502095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.502100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.502108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.502118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.502163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:31.505296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256789655113639:10396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:31.505311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256789655113639:10396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:31.505313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256789655113639:10396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:31.505326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:31.505583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:31.506550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:31.506565Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:31.506568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:31.506572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:31.506578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2566 [2:7556256787278192679:7292]
2025-10-01T14:15:31.506593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:31.506614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:31.506622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.506625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.506627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.506642Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:31.506653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:31.506659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:31.506722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.506730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.506732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.506735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:31.506737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:31.506807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:31.506818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.506830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.506841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.506857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:31.506880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113521:2446], now have 1 active actors on pipe
2025-10-01T14:15:31.506889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113677:10396], now have 1 active actors on pipe
2025-10-01T14:15:31.506896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.506902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.506905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.506917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:31.506890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2566
2025-10-01T14:15:31.506924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:31.506904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2566
2025-10-01T14:15:31.506931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:31.506932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:31.506934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:31.506944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:31.506947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:31.506967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.506978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.507018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.507032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:31.507048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:31.507047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:31.507061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.507065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.507068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:31.507080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.507089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:31.507123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.507277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.507286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.507302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.507378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2567 partition: 0 MaxSeqNo: 45 sessionId: src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0
2025-10-01T14:15:31.507755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c74211b-2d9a79fb-b5d72cc4-3fbacf4c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:31.510333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Write session: try to update token
2025-10-01T14:15:31.510350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:31.524782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId: src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:31.527274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:31.528023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.528048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.528066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:31.528068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:31.528071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:31.528072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:31.528078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.528085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.528091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256787278192673:7292]
2025-10-01T14:15:31.528127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:31.528137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:31.528141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:31.528142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.528144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:31.528145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:31.528281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:31.587959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256789655113687:3353]
2025-10-01T14:15:31.588231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2566, pipe: [1:7556256789655113687:3353]
2025-10-01T14:15:31.673710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:31.673928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:31.673975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113687:3353], now have 1 active actors on pipe
2025-10-01T14:15:31.674073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:31.674145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256789655113687:3353]
2025-10-01T14:15:31.674168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:31.674174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:31.674175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:31.674251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2567 reason: error at write: Disconnected sessionId: src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0
2025-10-01T14:15:31.674366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2567 sessionId: src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0 is DEAD
2025-10-01T14:15:31.674547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:31.674557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Write session will restart in 0.007157s
2025-10-01T14:15:31.674582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Write session: Do CDS request
2025-10-01T14:15:31.674591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:31.682863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.683004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:31.683020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2568
2025-10-01T14:15:31.683118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.683148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:31.683159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:31.683163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:31.683571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2568 sessionId:  describe result for acl check
2025-10-01T14:15:31.683605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:31.683611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:31.683613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:31.683618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256789655113782:10389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:31.684175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256789655113782:10389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:31.685452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:31.685955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256789655113782:10389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:31.687217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:31.687501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:31.687513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:31.687525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:31.687582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:31.687626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256787278192846:7278]
2025-10-01T14:15:31.687945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256789655113782:10389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:31.687958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256789655113782:10389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:31.687961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256789655113782:10389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:31.687968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:31.688196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:31.688404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:31.688445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:31.688742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:31.688790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.688796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.688797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.688798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.688799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.688800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.688802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.688803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.688804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.688805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.688806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.688807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.688808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.688809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.688814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.688823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.688827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.688831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.688834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.688838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.688845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.688849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.688856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.688860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.688864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.688867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.688871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.688878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.688884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.688896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.688906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.688914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.688923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.688932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.688939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.688948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.688952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.688958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.688961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.688966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.688970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.688974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.688978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.688986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.688992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.689000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.689007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.689012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.689020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.689028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.689036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.689044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.689052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.689056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.689061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.689068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.689109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:31.692459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:31.693190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:31.693205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:31.693207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:31.693211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:31.693217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2567 [2:7556256787278192846:7278]
2025-10-01T14:15:31.693230Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:31.693248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:31.693255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.693259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.693261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.693275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:31.693283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:31.693289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:31.693351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.693357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.693359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.693362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:31.693364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:31.693422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:31.693428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.693438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.693453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.693466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:31.693483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113695:2446], now have 1 active actors on pipe
2025-10-01T14:15:31.693491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113846:10389], now have 1 active actors on pipe
2025-10-01T14:15:31.693498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.693504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.693505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.693520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:31.693535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:31.693541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:31.693544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:31.693547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:31.693551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:31.693554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:31.693551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2567
2025-10-01T14:15:31.693576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.693582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:31.693587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:31.693570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2567
2025-10-01T14:15:31.693613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.693620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.693649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:31.693659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.693663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.693666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:31.693674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.693682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:31.693696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.693812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.693819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.693832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.693901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2568 partition: 0 MaxSeqNo: 45 sessionId: src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0
2025-10-01T14:15:31.694243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f82281-3bf6e9dc-d7f277d7-2a93a868_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:31.696802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Write session: try to update token
2025-10-01T14:15:31.696816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:31.709760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId: src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:31.712061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:31.713110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.713145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.713170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:31.713179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:31.713182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:31.713185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:31.713196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.713208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.713219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256787278192840:7278]
2025-10-01T14:15:31.713264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:31.713273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:31.713276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:31.713287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:31.713304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.713307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:31.713487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:31.774551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256789655113879:3353]
2025-10-01T14:15:31.774784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2567, pipe: [1:7556256789655113879:3353]
2025-10-01T14:15:31.873556Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:31.873875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:31.873933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113879:3353], now have 1 active actors on pipe
2025-10-01T14:15:31.874016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:31.874167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:31.874175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:31.874246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2568 reason: error at write: Disconnected sessionId: src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0
2025-10-01T14:15:31.874416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2568 sessionId: src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0 is DEAD
2025-10-01T14:15:31.874518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:31.874528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Write session will restart in 0.005942s
2025-10-01T14:15:31.874552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Write session: Do CDS request
2025-10-01T14:15:31.874558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:31.874576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:31.874622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256789655113879:3353]
2025-10-01T14:15:31.881847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.881895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:31.881907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2569
2025-10-01T14:15:31.882054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:31.882079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:31.882086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:31.882089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:31.882422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2569 sessionId:  describe result for acl check
2025-10-01T14:15:31.882450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:31.882455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:31.882456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:31.882460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256789655113996:10375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:31.882896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256789655113996:10375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:31.883141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:31.884831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256789655113996:10375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:31.884938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:31.885116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:31.885129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:31.885140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:31.885176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:31.885213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256787278193010:7284]
2025-10-01T14:15:31.885843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:31.886075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:31.886107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:31.886426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:31.886473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.886479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.886480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.886481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.886482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.886483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.886484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.886486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.886487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.886488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.886489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.886490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.886491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.886492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.886497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.886506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.886510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.886514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.886517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.886521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.886525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.886529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.886533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.886537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.886540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.886544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.886548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.886553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.886559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.886570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:31.886576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.886582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:31.886586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.886595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:31.886599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.886610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:31.886618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.886631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:31.886638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.886643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:31.886652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.886658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:31.886666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.886671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:31.886679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.886688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:31.886697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.886705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.886713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.886722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.886730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.886739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.886747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.886752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:31.886760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.886765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:31.886808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:31.887814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256789655113996:10375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:31.887837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256789655113996:10375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:31.887842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256789655113996:10375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:31.887855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:31.890240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:31.891035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:31.891048Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:31.891050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:31.891053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:31.891060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2568 [2:7556256787278193010:7284]
2025-10-01T14:15:31.891075Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:31.891095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:31.891102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.891106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.891111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.891125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:31.891134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:31.891144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:31.891196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.891202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.891204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.891207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:31.891210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:31.891270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:31.891277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.891290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:31.891305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:31.891325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:31.891356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655113882:2446], now have 1 active actors on pipe
2025-10-01T14:15:31.891364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655114037:10375], now have 1 active actors on pipe
2025-10-01T14:15:31.891371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.891373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.891375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.891386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:31.891358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2568
2025-10-01T14:15:31.891380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2568
2025-10-01T14:15:31.891399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:31.891398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:31.891401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:31.891402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:31.891417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:31.891419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:31.891457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.891466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.891477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.891488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:31.891492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:31.891515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9451f89-52a49339-b225cb18-b94f61bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:31.891525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:31.891533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:31.891539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:31.891549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:31.891562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:31.891581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.891708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.891715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.891728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:31.891796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2569 partition: 0 MaxSeqNo: 45 sessionId: src_id|e9451f89-52a49339-b225cb18-b94f61bc_0
2025-10-01T14:15:31.892118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274d688a-80024b5c-5e0e97f0-ebabfe27_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e9451f89-52a49339-b225cb18-b94f61bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:31.894589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Write session: try to update token
2025-10-01T14:15:31.894602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:31.907601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId: src_id|e9451f89-52a49339-b225cb18-b94f61bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:31.909945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:31.911343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:31.911364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:31.911384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:31.911388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:31.911390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:31.911392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:31.911402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.911406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.911410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256787278193005:7284]
2025-10-01T14:15:31.911471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:31.911482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:31.911487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:31.911618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:31.912724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:31.912730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:31.912734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:31.974687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256789655114045:3353]
2025-10-01T14:15:31.974952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2568, pipe: [1:7556256789655114045:3353]
2025-10-01T14:15:32.071127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:32.071619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:32.071689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256789655114045:3353], now have 1 active actors on pipe
2025-10-01T14:15:32.071776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:32.072259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256789655114045:3353]
2025-10-01T14:15:32.072277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:32.084194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:32.084651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:32.084666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:32.084690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2569 reason: error at write: Disconnected sessionId: src_id|e9451f89-52a49339-b225cb18-b94f61bc_0
2025-10-01T14:15:32.084850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2569 sessionId: src_id|e9451f89-52a49339-b225cb18-b94f61bc_0 is DEAD
2025-10-01T14:15:32.084981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:32.084991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Write session will restart in 0.006026s
2025-10-01T14:15:32.085017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Write session: Do CDS request
2025-10-01T14:15:32.085023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:32.090716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:32.091131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:32.091148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:32.091163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:32.091233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:32.091281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256791573160462:7282]
2025-10-01T14:15:32.091906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.091954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:32.091966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2570
2025-10-01T14:15:32.092137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.092168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:32.092177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:32.092181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:32.091903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:32.092268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:32.092327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:32.092683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:32.092754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.092760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.092761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.092762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.092764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.092765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.092766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.092768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.092769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.092771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.092772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.092773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.092774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.092775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.092781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.092790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.092794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.092798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.092801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.092804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.092808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.092811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.092814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.092818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.092822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.092825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.092828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.092825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2570 sessionId:  describe result for acl check
2025-10-01T14:15:32.092832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.092841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.092852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:32.092848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.092854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:32.092855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:32.092855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.092859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256793950081466:10367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:32.092860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.092865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.092870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.092874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.092879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.092884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.092888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.092892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.092897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.092902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.092906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.092910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.092916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.092926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.092933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.092939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.092944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.092952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.092956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.092960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.092970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.092974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.092978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.092986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.092991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.093029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:32.093267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256793950081466:10367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:32.095176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256793950081466:10367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:32.096953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:32.097632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:32.097649Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:32.097651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:32.097655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:32.097661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2569 [2:7556256791573160462:7282]
2025-10-01T14:15:32.097683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256793950081466:10367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:32.097698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256793950081466:10367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:32.097701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256793950081466:10367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:32.097708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:32.097727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:32.097758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:32.097761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.097765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.097767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.097788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:32.097799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:32.097806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:32.097881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.097891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.097893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.097896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:32.097898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:32.097975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:32.097985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.097999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.098010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.098029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:32.098052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081345:2446], now have 1 active actors on pipe
2025-10-01T14:15:32.098060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081513:10367], now have 1 active actors on pipe
2025-10-01T14:15:32.098068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.098070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.098073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.098086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:32.098078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2569
2025-10-01T14:15:32.098100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:32.098108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:32.098110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:32.098112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:32.098122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:32.098131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:32.098130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2569
2025-10-01T14:15:32.098177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.098190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:32.098203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:32.098205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.098209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.098256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:32.098268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.098272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.098278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:32.098286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.098299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:32.098322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.098476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.098484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.098499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.098566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2570 partition: 0 MaxSeqNo: 45 sessionId: src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0
2025-10-01T14:15:32.098895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9451f89-52a49339-b225cb18-b94f61bc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:32.101288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Write session: try to update token
2025-10-01T14:15:32.101303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:32.114929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId: src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:32.117325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:32.118210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.118233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.118257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:32.118260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.118262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:32.118264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:32.118272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.118282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.118286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256791573160457:7282]
2025-10-01T14:15:32.118333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:32.118340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:32.118346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.118349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:32.118350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:32.118354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:32.118501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:32.172332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256793950081525:3353]
2025-10-01T14:15:32.172635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2569, pipe: [1:7556256793950081525:3353]
2025-10-01T14:15:32.258840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:32.259109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:32.259157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081525:3353], now have 1 active actors on pipe
2025-10-01T14:15:32.259248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:32.259330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:32.259381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256793950081525:3353]
2025-10-01T14:15:32.270609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:32.270621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:32.270647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2570 reason: error at write: Disconnected sessionId: src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0
2025-10-01T14:15:32.270781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2570 sessionId: src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0 is DEAD
2025-10-01T14:15:32.270948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:32.270960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Write session will restart in 0.007196s
2025-10-01T14:15:32.270984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Write session: Do CDS request
2025-10-01T14:15:32.270993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:32.275585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:32.277422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:32.277629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:32.277641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:32.277653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:32.277703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:32.277744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256791573160652:7242]
2025-10-01T14:15:32.278353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:32.278724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:32.278778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:32.278890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.278942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:32.278959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2571
2025-10-01T14:15:32.279083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.279112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:32.279122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:32.279129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:32.279202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:32.279287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.279293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.279294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.279295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.279297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.279298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.279299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.279300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.279301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.279302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.279303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.279304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.279305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.279309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.279315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.279325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.279329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.279333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.279337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.279340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.279344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.279348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.279351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.279354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.279358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.279362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.279366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.279371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.279379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.279386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.279392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.279397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.279402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.279406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.279410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.279414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.279419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.279424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.279433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.279437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.279443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.279447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.279455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.279459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.279463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.279467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.279471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.279479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.279482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.279490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.279496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.279500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.279507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.279511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.279515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.279519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.279504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2571 sessionId:  describe result for acl check
2025-10-01T14:15:32.279533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:32.279535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:32.279536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:32.279541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256793950081649:10350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:32.279560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:32.280356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256793950081649:10350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:32.282153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256793950081649:10350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:32.283092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:32.283852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:32.283869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:32.283872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:32.283875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:32.283881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2570 [2:7556256791573160652:7242]
2025-10-01T14:15:32.283897Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:32.283912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:32.283915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.283919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.283921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.283937Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:32.283943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:32.283950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:32.284010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.284018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.284019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.284022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:32.284025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:32.284091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:32.284099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.284109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.284119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.284138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:32.284161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081526:2446], now have 1 active actors on pipe
2025-10-01T14:15:32.284170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.284173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.284175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.284185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:32.284168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2570
2025-10-01T14:15:32.284199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:32.284216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:32.284223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:32.284224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:32.284227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:32.284229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:32.284250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.284258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:32.284259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:32.284791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256793950081649:10350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:32.284803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256793950081649:10350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:32.284807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256793950081649:10350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:32.284814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:32.285113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2570
2025-10-01T14:15:32.285483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2571 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6e47967-f506780a-54068a08-9d138be3_0
2025-10-01T14:15:32.285801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdb7327d-185d11d9-9778c1a8-e0a84e8b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6e47967-f506780a-54068a08-9d138be3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:32.285064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081687:10350], now have 1 active actors on pipe
2025-10-01T14:15:32.285158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.285166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.285192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6e47967-f506780a-54068a08-9d138be3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:32.285199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.285202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.285204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:32.285211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.285223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:32.285242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.285388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.285393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.285413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.288617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Write session: try to update token
2025-10-01T14:15:32.288633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:32.297113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:32.297133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.297145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.297183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:32.297185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:32.297358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:32.297515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:32.297661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:32.297812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:32.298022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:32.298063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:32.302419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId: src_id|b6e47967-f506780a-54068a08-9d138be3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:32.304849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:32.305037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.305055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.305092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:32.305196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:32.315961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:32.315974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.315976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:32.315977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:32.315986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.315990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.315993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256791573160647:7242]
2025-10-01T14:15:32.316030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:32.316038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.316041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:32.316043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:32.316049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:32.316054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:32.316380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:32.359768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256793950081693:3353]
2025-10-01T14:15:32.360129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2570, pipe: [1:7556256793950081693:3353]
2025-10-01T14:15:32.469752Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:15:32.470100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:32.477647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.477671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.477822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.477882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.477942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.478005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.478187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.478196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.478261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.478317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.478409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.478472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.478514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.478519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.478576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.478630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.478687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.478788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.478827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.478835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.478892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.479166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.479224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.479289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.479328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.479333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.479418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.479486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.479544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.479601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.479641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.479646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.479702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.479780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.479836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.479890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.479931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.479936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.479996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.480069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.480126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.480193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.480244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.480249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.480306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.480359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.480414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.480478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.480521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.480538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.480597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.480656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.480709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.480763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.480807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.480812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.480914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.480973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.481037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.481091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.481130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.481135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.481186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081693:3353], now have 1 active actors on pipe
2025-10-01T14:15:32.481418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:32.481419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256793950081693:3353]
2025-10-01T14:15:32.481431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:32.481437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:32.481455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2571 reason: error at write: Disconnected sessionId: src_id|b6e47967-f506780a-54068a08-9d138be3_0
2025-10-01T14:15:32.481594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:32.481621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2571 sessionId: src_id|b6e47967-f506780a-54068a08-9d138be3_0 is DEAD
2025-10-01T14:15:32.481931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:32.481941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Write session will restart in 0.009272s
2025-10-01T14:15:32.481960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Write session: Do CDS request
2025-10-01T14:15:32.481965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:32.492072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:32.492927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.493003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:32.493016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2572
2025-10-01T14:15:32.493156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.493195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:32.493205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:32.493208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:32.493579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2572 sessionId:  describe result for acl check
2025-10-01T14:15:32.493612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:32.493618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:32.493619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:32.493624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256793950081817:10348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:32.493687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:32.493825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:32.493832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:32.493841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:32.493873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:32.493898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256791573160810:7239]
2025-10-01T14:15:32.494088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256793950081817:10348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:32.494289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:32.494508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:32.494535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:32.494721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:32.494756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.494760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.494761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.494761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.494762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.494762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.494763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.494764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.494764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.494765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.494766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.494766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.494767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.494768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.494770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.494776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.494778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.494780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.494782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.494784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.494786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.494788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.494790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.494792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.494794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.494796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.494798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.494800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.494805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.494809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.494813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.494816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.494818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.494821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.494823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.494826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.494829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.494832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.494834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.494836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.494842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.494845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.494847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.494850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.494853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.494856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.494858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.494861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.494863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.494865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.494868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.494870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.494873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.494875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.494878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.494880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.494900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:32.496760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256793950081817:10348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:32.498340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:32.499124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256793950081817:10348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:32.499137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256793950081817:10348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:32.499140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256793950081817:10348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:32.499148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:32.499338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:32.499351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:32.499353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:32.499356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:32.499364Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2571 [2:7556256791573160810:7239]
2025-10-01T14:15:32.499379Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:32.499395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:32.499406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.499409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.499412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.499426Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:32.499431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:32.499442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:32.499494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.499503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.499505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.499508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:32.499511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:32.499584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:32.499591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.499604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.499615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.499635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:32.499655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081696:2446], now have 1 active actors on pipe
2025-10-01T14:15:32.499662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081855:10348], now have 1 active actors on pipe
2025-10-01T14:15:32.499669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.499671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.499672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.499687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:32.499700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:32.499716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:32.499722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:32.499738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:32.499745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:32.499746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:32.499754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.499756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:32.499719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2571
2025-10-01T14:15:32.499719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2571
2025-10-01T14:15:32.499766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:32.499788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.499798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.499825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:32.499832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.499838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.499844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:32.499853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.499862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:32.499875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.500008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.500016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.500030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.500104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2572 partition: 0 MaxSeqNo: 45 sessionId: src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0
2025-10-01T14:15:32.500419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e47967-f506780a-54068a08-9d138be3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:32.503141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Write session: try to update token
2025-10-01T14:15:32.503160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:32.516759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId: src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:32.519122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:32.519768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.519788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.519810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:32.519813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.519815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:32.519817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:32.519824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.519829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.519832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256791573160804:7239]
2025-10-01T14:15:32.519866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:32.519875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:32.519879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:32.519883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:32.519890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.519895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:32.520042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:32.581425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256793950081865:3353]
2025-10-01T14:15:32.581726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2571, pipe: [1:7556256793950081865:3353]
2025-10-01T14:15:32.667639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:32.667969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:32.668032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081865:3353], now have 1 active actors on pipe
2025-10-01T14:15:32.668109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:32.668214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256793950081865:3353]
2025-10-01T14:15:32.668242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:32.679913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:32.679926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:32.679952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2572 reason: error at write: Disconnected sessionId: src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0
2025-10-01T14:15:32.680098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2572 sessionId: src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0 is DEAD
2025-10-01T14:15:32.680255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:32.680267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Write session will restart in 0.008063s
2025-10-01T14:15:32.680293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Write session: Do CDS request
2025-10-01T14:15:32.680300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:32.689655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:32.689909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.690006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:32.690021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2573
2025-10-01T14:15:32.690190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.690223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:32.690232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:32.690237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:32.692284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2573 sessionId:  describe result for acl check
2025-10-01T14:15:32.692319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:32.692321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:32.692322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:32.692303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:32.692328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256793950081995:10334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:32.692553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:32.692575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:32.692587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:32.692645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:32.692704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256791573160981:7236]
2025-10-01T14:15:32.693228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256793950081995:10334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:32.693346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:32.693643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:32.693697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:32.693927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:32.693965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.693969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.693970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.693971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.693972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.693973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.693974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.693975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.693976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.693978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.693979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.693980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.693981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.693982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.693987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.693995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.693999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.694003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.694007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.694009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.694011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.694013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.694015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.694017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.694019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.694021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.694023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.694025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.694031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.694035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.694039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.694043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.694047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.694052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.694056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.694061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.694066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.694071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.694075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.694080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.694083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.694086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.694089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.694112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.694118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.694123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.694127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.694132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.694137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.694142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.694150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.694153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.694156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.694158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.694162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.694165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.694187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:32.695890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256793950081995:10334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:32.698032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:32.698927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:32.698940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:32.698942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:32.698946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:32.698952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2572 [2:7556256791573160981:7236]
2025-10-01T14:15:32.698967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:32.698989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:32.698995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.698998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.699001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.699016Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:32.699021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:32.699030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:32.699057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256793950081995:10334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:32.699082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.699089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.699090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.699071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256793950081995:10334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:32.699093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:32.699074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256793950081995:10334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:32.699082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:32.699096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:32.699157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:32.699163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.699175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.699187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.699205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:32.699223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950081873:2446], now have 1 active actors on pipe
2025-10-01T14:15:32.699235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.699241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.699243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.699252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2572
2025-10-01T14:15:32.699259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:32.699275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:32.699284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:32.699287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:32.699289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:32.699291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:32.699294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:32.699333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.699339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:32.699345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:32.699362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950082033:10334], now have 1 active actors on pipe
2025-10-01T14:15:32.699406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2572
2025-10-01T14:15:32.699440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.699448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.699469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:32.699480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.699484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.699490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:32.699500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.699512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:32.699529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.699674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.699687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.699709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.699800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2573 partition: 0 MaxSeqNo: 45 sessionId: src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0
2025-10-01T14:15:32.700137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2e3855-f3a8c82c-273e0c5c-62bea194_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:32.702792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Write session: try to update token
2025-10-01T14:15:32.702810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:32.716034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:32.716049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.716060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.716108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:32.716118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:32.716280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:32.716415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:32.716477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId: src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:32.716568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:32.716717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:32.716919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:32.716959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:32.719085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:32.719267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.719288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.719322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:32.719426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:32.729772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:32.729789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.729792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:32.729794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:32.729804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.729809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.729813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256791573160976:7236]
2025-10-01T14:15:32.729861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:32.729870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.729872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:32.729871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:32.729880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:32.729883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:32.730014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:32.768299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256793950082040:3353]
2025-10-01T14:15:32.768566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2572, pipe: [1:7556256793950082040:3353]
2025-10-01T14:15:32.883761Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:32.892811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.892835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.893113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.893267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.893325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.893380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.893846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.893856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.894043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.894226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.894442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.894650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.894751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.894757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.894820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.894874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.894933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.894992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.895031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.895036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.895097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.895298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.895495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.895556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.895596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.895601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.895657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.895724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.895781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.895835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.895874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.895879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.895936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.895993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.896049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.896108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.896148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.896154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.896214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.896369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.896548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.896610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.896701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.896706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.896764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.896818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.896875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.896932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.896987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.896994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.897064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.897134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.897218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.897289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.897336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.897343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.897415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:32.897482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:32.897584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:32.897690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:32.897737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:32.897744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:32.897831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950082040:3353], now have 1 active actors on pipe
2025-10-01T14:15:32.898053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256793950082040:3353]
2025-10-01T14:15:32.898075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:32.898084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:32.898087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:32.898108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2573 reason: error at write: Disconnected sessionId: src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0
2025-10-01T14:15:32.898256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2573 sessionId: src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0 is DEAD
2025-10-01T14:15:32.898440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:32.898450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Write session will restart in 0.006334s
2025-10-01T14:15:32.898478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Write session: Do CDS request
2025-10-01T14:15:32.898484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:32.898529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:32.905821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.905939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:32.905950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2574
2025-10-01T14:15:32.906038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:32.906060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:32.906067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:32.906069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:32.906443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2574 sessionId:  describe result for acl check
2025-10-01T14:15:32.906477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:32.906483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:32.906484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:32.906489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256793950082120:10322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:32.906905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256793950082120:10322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:32.909207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256793950082120:10322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:32.909343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:32.911131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:32.911309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:32.911321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:32.911331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:32.911394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:32.911425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256791573161150:7231]
2025-10-01T14:15:32.911605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256793950082120:10322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:32.911617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256793950082120:10322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:32.911621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256793950082120:10322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:32.911627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:32.912003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:32.912228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:32.912263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:32.912551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:32.912596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.912601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.912602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.912603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.912604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.912605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.912606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.912607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.912608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.912609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.912610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.912611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.912612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.912613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.912618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.912628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.912632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.912635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.912639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.912643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.912646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.912649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.912653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.912656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.912660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.912663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.912667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.912670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.912676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.912683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:32.912688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.912693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:32.912697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.912702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:32.912705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.912710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:32.912714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.912719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:32.912723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.912728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:32.912732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.912737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:32.912741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.912745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:32.912749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.912754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:32.912759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.912763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.912767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.912772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.912775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.912780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.912788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.912793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:32.912797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.912801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:32.912843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:32.916392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:32.917335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:32.917349Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:32.917352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:32.917356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:32.917362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2573 [2:7556256791573161150:7231]
2025-10-01T14:15:32.917376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:32.917392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:32.917395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.917398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.917401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.917417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:32.917428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:32.917435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:32.917491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.917499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.917501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.917505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:32.917507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:32.917581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:32.917590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.917602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:32.917613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:32.917629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:32.917647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950082065:2446], now have 1 active actors on pipe
2025-10-01T14:15:32.917655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950082222:10322], now have 1 active actors on pipe
2025-10-01T14:15:32.917663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.917670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.917672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.917687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:32.917704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:32.917706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:32.917709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:32.917711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:32.917719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:32.917722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:32.917750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.917707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2573
2025-10-01T14:15:32.917757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:32.917726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2573
2025-10-01T14:15:32.917760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:32.917776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.917785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.917833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:32.917846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:32.917852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:32.917858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:32.917867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:32.917881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:32.917903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.918042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:32.918050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:32.918064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:32.918130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2574 partition: 0 MaxSeqNo: 45 sessionId: src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0
2025-10-01T14:15:32.918486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96a9404-f051215f-b03c1f87-6b69dc2a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:32.921069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Write session: try to update token
2025-10-01T14:15:32.921087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:32.937290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId: src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:32.939747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:32.939770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:32.939773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:32.939776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:32.939787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.939792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.939797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256791573161144:7231]
2025-10-01T14:15:32.939846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:32.939852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:32.939852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:32.939856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:32.939860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:32.939862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:32.939912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:32.940045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:32.998187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256793950082234:3353]
2025-10-01T14:15:32.998476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2573, pipe: [1:7556256793950082234:3353]
2025-10-01T14:15:33.096654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:33.097006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.097022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.097060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256793950082234:3353], now have 1 active actors on pipe
2025-10-01T14:15:33.097244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:33.097261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256793950082234:3353]
2025-10-01T14:15:33.097289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:33.097289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:33.097346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2574 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0
2025-10-01T14:15:33.097521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2574 sessionId: src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0 is DEAD
2025-10-01T14:15:33.097657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:33.097668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Write session will restart in 0.009835s
2025-10-01T14:15:33.097696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Write session: Do CDS request
2025-10-01T14:15:33.097703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:33.108935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.108999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:33.109017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2575
2025-10-01T14:15:33.109170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.109213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:33.109224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:33.109228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:33.109694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2575 sessionId:  describe result for acl check
2025-10-01T14:15:33.109736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:33.109738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:33.109739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:33.109744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256798245049601:10314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:33.110317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256798245049601:10314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:33.112354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256798245049601:10314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:33.113987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:33.116021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256798245049601:10314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:33.116029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:33.116036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256798245049601:10314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:33.116039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256798245049601:10314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:33.116047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:33.116239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:33.116251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:33.116263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:33.116316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:33.116355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256795868128610:7230]
2025-10-01T14:15:33.116915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:33.117196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:33.117240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:33.117563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:33.117623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.117624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.117626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.117627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.117628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.117630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.117631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.117633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.117634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.117635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.117636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.117637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.117638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.117639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.117645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.117656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.117659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.117663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.117667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.117671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.117674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.117678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.117681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.117685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.117688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.117693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.117696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.117699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.117708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.117715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.117721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.117727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.117732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.117737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.117741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.117746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.117751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.117756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.117760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.117765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.117770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.117775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.117780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.117785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.117790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.117795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.117799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.117804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.117814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.117818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.117824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.117833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.117837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.117846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.117850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.117859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.117897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:33.122225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:33.123191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:33.123206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:33.123209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:33.123213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:33.123219Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2574 [2:7556256795868128610:7230]
2025-10-01T14:15:33.123236Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:33.123254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:33.123258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.123262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.123264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.123281Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:33.123287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:33.123293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:33.123353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.123359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.123361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.123364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:33.123367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:33.123561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2574
2025-10-01T14:15:33.123566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2574
2025-10-01T14:15:33.123433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:33.123442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.123456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.123465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.123477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:33.123497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049704:10314], now have 1 active actors on pipe
2025-10-01T14:15:33.123500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049546:2446], now have 1 active actors on pipe
2025-10-01T14:15:33.123508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.123510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.123512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.123521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:33.123530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:33.123533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:33.123535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:33.123537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:33.123550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:33.123553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:33.123591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.123594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:33.123597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:33.123632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.123638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.123666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:33.123673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.123678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.123680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:33.123691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.123700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:33.123714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.123872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.123880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.123895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.123979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2575 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0
2025-10-01T14:15:33.124334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cc7b4-93a9de59-6f7a1b64-a9e385be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:33.127032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Write session: try to update token
2025-10-01T14:15:33.127052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:33.141725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId: src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:33.144546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:33.144898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.144922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.144941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:33.144944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:33.144946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:33.144947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:33.144954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.144958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.144961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256795868128604:7230]
2025-10-01T14:15:33.144997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:33.145003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:33.145007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:33.145013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:33.145028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.145030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:33.145177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:33.197356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256798245049716:3353]
2025-10-01T14:15:33.197606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2574, pipe: [1:7556256798245049716:3353]
2025-10-01T14:15:33.295327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:33.295692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:33.295750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049716:3353], now have 1 active actors on pipe
2025-10-01T14:15:33.295833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:33.295924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:33.295930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:33.295932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256798245049716:3353]
2025-10-01T14:15:33.295957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:33.295995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2575 reason: error at write: Disconnected sessionId: src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0
2025-10-01T14:15:33.296146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2575 sessionId: src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0 is DEAD
2025-10-01T14:15:33.296262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:33.296273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Write session will restart in 0.009528s
2025-10-01T14:15:33.296307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Write session: Do CDS request
2025-10-01T14:15:33.296316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:33.308032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:33.308680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:33.308975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:33.308985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:33.308998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:33.309050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:33.309085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256795868128802:7205]
2025-10-01T14:15:33.309679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:33.309958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:33.310000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:33.310305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:33.310359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.310365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.310366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.310367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.310381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.310382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.310383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.310384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.310385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.310386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.310388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.310389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.310390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.310391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.310396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.310406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.310411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.310415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.310419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.310423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.310427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.310431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.310435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.310438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.310442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.310446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.310450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.310454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.310470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.310478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.310487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.310493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.310501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.310506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.310514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.310520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.310524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.310529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.310538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.310543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.310552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.310557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.310565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.310570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.310578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.310584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.310591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.310596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.310606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.310614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.310618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.310626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.310634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.310643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.310648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.310656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.310693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:33.310866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.310971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:33.310984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2576
2025-10-01T14:15:33.311125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.311163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:33.311173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:33.311180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:33.311541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2576 sessionId:  describe result for acl check
2025-10-01T14:15:33.311569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:33.311583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:33.311585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:33.311590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256798245049848:10307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:33.312060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256798245049848:10307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:33.313735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256798245049848:10307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:33.314431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:33.315178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:33.315194Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:33.315196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:33.315200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:33.315206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2575 [2:7556256795868128802:7205]
2025-10-01T14:15:33.315222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:33.315238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:33.315241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.315244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.315246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.315263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:33.315268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:33.315274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:33.315332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.315341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.315343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.315346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:33.315348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:33.315481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:33.315490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.315503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.315514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.315529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:33.315517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2575
2025-10-01T14:15:33.315551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049718:2446], now have 1 active actors on pipe
2025-10-01T14:15:33.315563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.315569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.315571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.315582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:33.315590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:33.315593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:33.315595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:33.315599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:33.315613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:33.315620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:33.315674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.315687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:33.315693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:33.321729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256798245049848:10307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:33.321745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256798245049848:10307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:33.321748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256798245049848:10307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:33.321756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:33.322017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2575
2025-10-01T14:15:33.322004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049885:10307], now have 1 active actors on pipe
2025-10-01T14:15:33.322080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.322091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.322120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24758cf8-e408728-bcc24218-599a9d6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:33.322134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.322144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.322147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:33.322159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.322180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:33.322202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.322412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.322424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.322445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.322558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2576 partition: 0 MaxSeqNo: 45 sessionId: src_id|24758cf8-e408728-bcc24218-599a9d6d_0
2025-10-01T14:15:33.322866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b820f0-81da0ac7-4c921e77-fb749c6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|24758cf8-e408728-bcc24218-599a9d6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:33.325309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Write session: try to update token
2025-10-01T14:15:33.325323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:33.327381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:33.327397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:33.327408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.327445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:33.327455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:33.327638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:33.327788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:33.327947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:33.328088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:33.328283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:33.328326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:33.339178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId: src_id|24758cf8-e408728-bcc24218-599a9d6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:33.342207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:33.342455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.342475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.342509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:33.342604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:33.347318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:33.347336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:33.347338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:33.347339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:33.347348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.347353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.347356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256795868128796:7205]
2025-10-01T14:15:33.347394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:33.347398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:33.347404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:33.347405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.347407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:33.347410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:33.347542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:33.396009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256798245049889:3353]
2025-10-01T14:15:33.396252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2575, pipe: [1:7556256798245049889:3353]
2025-10-01T14:15:33.495886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:33.503120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.503139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.503274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.503324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.503376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.503425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.503474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.503482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.503570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.503619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.503695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.503877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.503916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.503922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.503979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.504030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.504083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.504140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.504180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.504185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.504245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.504296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.504349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.504402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.504440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.504446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.504501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.504569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.504626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.504678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.504718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.504723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.504779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.504839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.504899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.504953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.505034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.505039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.505100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.505149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.505203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.505256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.505306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.505311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.505368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.505420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.505475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.505526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.505566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.505572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.505627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.505679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.505735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.505791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.505831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.505836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.505894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:33.505954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:33.506006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:33.506059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:33.506099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:33.506104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:33.506144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049889:3353], now have 1 active actors on pipe
2025-10-01T14:15:33.506360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256798245049889:3353]
2025-10-01T14:15:33.506403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:33.506409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:33.506411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:33.506436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2576 reason: error at write: Disconnected sessionId: src_id|24758cf8-e408728-bcc24218-599a9d6d_0
2025-10-01T14:15:33.506612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2576 sessionId: src_id|24758cf8-e408728-bcc24218-599a9d6d_0 is DEAD
2025-10-01T14:15:33.506710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:33.506720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Write session will restart in 0.009503s
2025-10-01T14:15:33.506744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Write session: Do CDS request
2025-10-01T14:15:33.506749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:33.507076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:33.516710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:33.517801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.517916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:33.517927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2577
2025-10-01T14:15:33.518024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.518048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:33.518051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:33.518054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:33.518334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2577 sessionId:  describe result for acl check
2025-10-01T14:15:33.518358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:33.518359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:33.518360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:33.518363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256798245050018:10299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:33.518588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:33.518739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:33.518747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:33.518755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:33.518747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256798245050018:10299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:33.518791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:33.518819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256795868128965:7200]
2025-10-01T14:15:33.519180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:33.519388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:33.519419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:33.519675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:33.519722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.519728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.519729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.519730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.519731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.519732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.519733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.519734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.519735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.519736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.519737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.519738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.519739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.519740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.519744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.519753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.519757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.519761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.519764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.519768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.519771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.519774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.519777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.519781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.519788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.519791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.519794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.519801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.519808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.519819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.519827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.519836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.519843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.519848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.519855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.519860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.519868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.519873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.519880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.519885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.519892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.519897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.519905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.519911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.519918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.519923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.519930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.519935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.519944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.519952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.519959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.519964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.519971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.519975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.519982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.519987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.520026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:33.520694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256798245050018:10299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:33.523217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256798245050018:10299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:33.523231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256798245050018:10299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:33.523235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256798245050018:10299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:33.523243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:33.523447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:33.524093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:33.524104Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:33.524106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:33.524110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:33.524116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2576 [2:7556256795868128965:7200]
2025-10-01T14:15:33.524130Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:33.524147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:33.524154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.524157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.524159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.524175Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:33.524185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:33.524190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:33.524240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.524245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.524247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.524251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:33.524253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:33.524311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:33.524318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.524328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.524340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.524358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:33.524378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245049892:2446], now have 1 active actors on pipe
2025-10-01T14:15:33.524386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050056:10299], now have 1 active actors on pipe
2025-10-01T14:15:33.524392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.524395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.524397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.524410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:33.524417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:33.524419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:33.524422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:33.524427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:33.524405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2576
2025-10-01T14:15:33.524439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:33.524446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:33.524416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2576
2025-10-01T14:15:33.524479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.524487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.524499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.524510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:33.524529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:33.524553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:33.524563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.524569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.524575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:33.524583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.524592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:33.524616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.524757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.524764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.524777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.524846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2577 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0
2025-10-01T14:15:33.525202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24758cf8-e408728-bcc24218-599a9d6d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:33.527605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Write session: try to update token
2025-10-01T14:15:33.527621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:33.540703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId: src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:33.543774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:33.544674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.544700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.544722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:33.544725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:33.544728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:33.544732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:33.544741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.544748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.544756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256795868128959:7200]
2025-10-01T14:15:33.544789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:33.544798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:33.544802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:33.544816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:33.544822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.544825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:33.545577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:33.606473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256798245050066:3353]
2025-10-01T14:15:33.606766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2576, pipe: [1:7556256798245050066:3353]
2025-10-01T14:15:33.693878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:33.694358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:33.694435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050066:3353], now have 1 active actors on pipe
2025-10-01T14:15:33.694525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:33.694592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256798245050066:3353]
2025-10-01T14:15:33.694620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:33.694697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:33.694705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:33.694793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2577 reason: error at write: Disconnected sessionId: src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0
2025-10-01T14:15:33.694931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2577 sessionId: src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0 is DEAD
2025-10-01T14:15:33.695092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:33.695103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Write session will restart in 0.009778s
2025-10-01T14:15:33.695132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Write session: Do CDS request
2025-10-01T14:15:33.695140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:33.705940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.705996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:33.706009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2578
2025-10-01T14:15:33.706174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.706205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:33.706214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:33.706217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:33.706629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2578 sessionId:  describe result for acl check
2025-10-01T14:15:33.706662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:33.706668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:33.706669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:33.706678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256798245050199:10292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:33.707039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:33.707169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256798245050199:10292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:33.708955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256798245050199:10292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:33.709168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:33.709360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:33.709370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:33.709381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:33.709443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:33.709483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256795868129141:7194]
2025-10-01T14:15:33.710033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:33.710303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:33.710339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:33.710636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:33.710688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.710693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.710694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.710695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.710696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.710697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.710698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.710700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.710700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.710701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.710702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.710703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.710704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.710705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.710709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.710719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.710723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.710727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.710730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.710734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.710737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.710741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.710744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.710748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.710752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.710755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.710759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.710762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.710768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.710775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.710781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.710786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.710790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.710795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.710806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.710810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.710815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.710819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.710822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.710827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.710831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.710836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.710840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.710845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.710849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.710854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.710858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.710863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.710867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.710872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.710876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.710881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.710885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.710889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.710894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.710899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.710922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256798245050199:10292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:33.710934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256798245050199:10292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:33.710938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256798245050199:10292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:33.710931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:33.710945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:33.714319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:33.714956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:33.714967Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:33.714970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:33.714973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:33.714980Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2577 [2:7556256795868129141:7194]
2025-10-01T14:15:33.714995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:33.715013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:33.715015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.715018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.715020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.715037Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:33.715048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:33.715054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:33.715108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.715114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.715116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.715120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:33.715122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:33.715187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:33.715194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.715205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.715216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.715229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:33.715250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050074:2446], now have 1 active actors on pipe
2025-10-01T14:15:33.715257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050237:10292], now have 1 active actors on pipe
2025-10-01T14:15:33.715265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.715270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.715272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.715286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:33.715301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:33.715307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:33.715311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:33.715314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:33.715317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:33.715320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:33.715316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2577
2025-10-01T14:15:33.715332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2577
2025-10-01T14:15:33.715345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.715350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:33.715352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:33.715374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.715378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.715408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:33.715421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.715426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.715432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:33.715441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.715453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:33.715473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.715611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.715621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.715634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.715705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2578 partition: 0 MaxSeqNo: 45 sessionId: src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0
2025-10-01T14:15:33.716063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f3e190-50f2d1b8-227582de-b130f06d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:33.718638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Write session: try to update token
2025-10-01T14:15:33.718659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:33.733584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId: src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:33.736124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:33.736274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:33.736297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:33.736300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:33.736302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:33.736311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.736316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.736319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256795868129136:7194]
2025-10-01T14:15:33.736353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:33.736359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:33.736363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:33.736378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.736387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.736407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:33.736417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.736420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:33.736607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:33.794871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256798245050246:3353]
2025-10-01T14:15:33.795119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2577, pipe: [1:7556256798245050246:3353]
2025-10-01T14:15:33.880897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:33.881159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050246:3353], now have 1 active actors on pipe
2025-10-01T14:15:33.881369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:33.881373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256798245050246:3353]
2025-10-01T14:15:33.881381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:33.881398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:33.881428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:33.881450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2578 reason: error at write: Disconnected sessionId: src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0
2025-10-01T14:15:33.881636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2578 sessionId: src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0 is DEAD
2025-10-01T14:15:33.881762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:33.881769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Write session will restart in 0.005915s
2025-10-01T14:15:33.881788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Write session: Do CDS request
2025-10-01T14:15:33.881792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:33.888861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.888948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:33.888960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2579
2025-10-01T14:15:33.889089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:33.889141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:33.889152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:33.889156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:33.889647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2579 sessionId:  describe result for acl check
2025-10-01T14:15:33.889678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:33.889680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:33.889682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:33.889686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256798245050349:10279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:33.890161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256798245050349:10279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:33.892078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256798245050349:10279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:33.892181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:33.893879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:33.894055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:33.894065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:33.894076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:33.894121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:33.894157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256795868129315:7188]
2025-10-01T14:15:33.894534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256798245050349:10279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:33.894546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256798245050349:10279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:33.894549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256798245050349:10279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:33.894557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:33.894699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:33.894935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:33.894975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:33.895244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:33.895372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.895379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.895380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.895380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.895381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.895382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.895383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.895384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.895385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.895386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.895387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.895388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.895389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.895390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.895394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.895402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.895405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.895408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.895411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.895415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.895418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.895421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.895425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.895428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.895431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.895434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.895437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.895440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.895449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.895456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:33.895461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.895466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:33.895469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.895474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:33.895477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.895481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:33.895485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.895489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:33.895492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.895496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:33.895499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.895504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:33.895507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.895511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:33.895515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.895519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:33.895528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.895533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.895541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.895545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.895548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.895553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.895572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.895581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:33.895584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.895588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:33.895626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:33.899075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:33.899952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:33.899966Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:33.899968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:33.899972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:33.899979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2578 [2:7556256795868129315:7188]
2025-10-01T14:15:33.899993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:33.900009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:33.900026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.900029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.900031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.900047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:33.900059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:33.900064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:33.900125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.900132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.900134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.900137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:33.900140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:33.900204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:33.900211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.900222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:33.900232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:33.900247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:33.900269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050273:2446], now have 1 active actors on pipe
2025-10-01T14:15:33.900272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050432:10279], now have 1 active actors on pipe
2025-10-01T14:15:33.900279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.900281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.900283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.900298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:33.900307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:33.900312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:33.900320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:33.900326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:33.900328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:33.900328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:33.900355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.900364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:33.900370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:33.900339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2578
2025-10-01T14:15:33.900351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2578
2025-10-01T14:15:33.900401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.900409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.900438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30f31014-72412bc6-ed2e0f87-27458db5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:33.900449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:33.900453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:33.900456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:33.900465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:33.900473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:33.900492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.900620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.900627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.900641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:33.900738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2579 partition: 0 MaxSeqNo: 45 sessionId: src_id|30f31014-72412bc6-ed2e0f87-27458db5_0
2025-10-01T14:15:33.901101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9b1ee9-813ff7e8-9110d0d3-6fc73514_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30f31014-72412bc6-ed2e0f87-27458db5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:33.903767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Write session: try to update token
2025-10-01T14:15:33.903784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:33.917602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId: src_id|30f31014-72412bc6-ed2e0f87-27458db5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:33.920169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:33.921235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:33.921266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:33.921289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:33.921292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:33.921294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:33.921296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:33.921305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.921309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.921313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256795868129309:7188]
2025-10-01T14:15:33.921356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:33.921369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:33.921373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:33.921377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:33.921385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:33.921388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:33.921536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:33.981763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256798245050444:3353]
2025-10-01T14:15:33.982069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2578, pipe: [1:7556256798245050444:3353]
2025-10-01T14:15:34.072225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:34.072614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:34.072674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256798245050444:3353], now have 1 active actors on pipe
2025-10-01T14:15:34.072754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:34.072920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256798245050444:3353]
2025-10-01T14:15:34.072953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:34.082989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:34.083003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:34.083023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2579 reason: error at write: Disconnected sessionId: src_id|30f31014-72412bc6-ed2e0f87-27458db5_0
2025-10-01T14:15:34.083148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2579 sessionId: src_id|30f31014-72412bc6-ed2e0f87-27458db5_0 is DEAD
2025-10-01T14:15:34.083285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:34.083297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Write session will restart in 0.005528s
2025-10-01T14:15:34.083323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Write session: Do CDS request
2025-10-01T14:15:34.083333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:34.089953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.090412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:34.090427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2580
2025-10-01T14:15:34.090564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.090597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:34.090609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:34.090613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:34.091013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2580 sessionId:  describe result for acl check
2025-10-01T14:15:34.091051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:34.091052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:34.091053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:34.091057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256802540017859:10269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:34.091508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256802540017859:10269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:34.093060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:34.094036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256802540017859:10269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:34.095620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:34.095810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:34.095818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:34.095827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:34.095866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:34.095898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256800163096777:7177]
2025-10-01T14:15:34.096336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:34.096642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:34.096696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:34.096760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256802540017859:10269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:34.096775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256802540017859:10269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:34.096779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256802540017859:10269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:34.096787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:34.097007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:34.097065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.097071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.097072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.097074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.097075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.097076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.097077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.097079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.097080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.097082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.097083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.097084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.097085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.097086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.097092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.097102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.097106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.097110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.097114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.097118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.097122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.097126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.097130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.097134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.097138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.097142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.097146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.097150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.097158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.097166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.097172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.097177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.097181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.097184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.097187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.097190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.097192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.097195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.097198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.097201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.097206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.097209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.097211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.097214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.097216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.097219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.097222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.097225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.097227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.097230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.097233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.097235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.097237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.097240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.097243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.097246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.097267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:34.101097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:34.101711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:34.101723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:34.101726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:34.101729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:34.101737Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2579 [2:7556256800163096777:7177]
2025-10-01T14:15:34.101753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:34.101767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:34.101772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.101775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.101777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.101790Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:34.101798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:34.101803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:34.101855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.101862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.101864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.101866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:34.101869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:34.101923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:34.101928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.101936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.101942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.101951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:34.101969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540017909:10269], now have 1 active actors on pipe
2025-10-01T14:15:34.101976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540017744:2446], now have 1 active actors on pipe
2025-10-01T14:15:34.101984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.101993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.101997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.102009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:34.102020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:34.102022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:34.102024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:34.102027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:34.102029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:34.102032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:34.102035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2579
2025-10-01T14:15:34.102064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2579
2025-10-01T14:15:34.102068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.102077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:34.102078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:34.102100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.102114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.102169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:34.102176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.102179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.102181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:34.102188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.102196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:34.102215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.102420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.102433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.102449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.102535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2580 partition: 0 MaxSeqNo: 45 sessionId: src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0
2025-10-01T14:15:34.103059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f31014-72412bc6-ed2e0f87-27458db5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:34.105840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Write session: try to update token
2025-10-01T14:15:34.105861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:34.120747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId: src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:34.124396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:34.124616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:34.124632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.124634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:34.124637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:34.124647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.124653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.124657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256800163096772:7177]
2025-10-01T14:15:34.124699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:34.124716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.124721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:34.124725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:34.124726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.124743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:34.124753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.124754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:34.124877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:34.173240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256802540017931:3353]
2025-10-01T14:15:34.173542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2579, pipe: [1:7556256802540017931:3353]
2025-10-01T14:15:34.275425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:34.275994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540017931:3353], now have 1 active actors on pipe
2025-10-01T14:15:34.276224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:34.276228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:34.276241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:34.276245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:34.276290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256802540017931:3353]
2025-10-01T14:15:34.276301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2580 reason: error at write: Disconnected sessionId: src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0
2025-10-01T14:15:34.276492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2580 sessionId: src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0 is DEAD
2025-10-01T14:15:34.276656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:34.276667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Write session will restart in 0.007071s
2025-10-01T14:15:34.276701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Write session: Do CDS request
2025-10-01T14:15:34.276707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:34.284938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.285041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:34.285056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2581
2025-10-01T14:15:34.285191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.285224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:34.285230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:34.285236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:34.285672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2581 sessionId:  describe result for acl check
2025-10-01T14:15:34.285708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:34.285714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:34.285715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:34.285720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256802540018028:10263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:34.286202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256802540018028:10263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:34.288003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:34.288099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256802540018028:10263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:34.289955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:34.290149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:34.290159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:34.290167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:34.290223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:34.290259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256800163096977:7160]
2025-10-01T14:15:34.290620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256802540018028:10263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:34.290634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256802540018028:10263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:34.290637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256802540018028:10263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:34.290645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:34.290832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:34.291057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:34.291100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:34.291386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:34.291451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.291456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.291457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.291458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.291459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.291460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.291461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.291462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.291463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.291464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.291465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.291466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.291467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.291468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.291473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.291481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.291485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.291489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.291496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.291499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.291503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.291511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.291514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.291522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.291525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.291533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.291536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.291543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.291550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.291561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.291570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.291575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.291583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.291587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.291594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.291599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.291607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.291612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.291620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.291624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.291628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.291636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.291639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.291643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.291651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.291657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.291664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.291668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.291672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.291679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.291682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.291686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.291692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.291699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.291704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.291711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.291747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:34.295176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:34.295770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:34.295782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:34.295783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:34.295786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:34.295790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2580 [2:7556256800163096977:7160]
2025-10-01T14:15:34.295973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:34.295989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:34.295994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.295996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.295998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.296009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:34.296016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:34.296021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:34.296059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.296063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.296064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.296066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:34.296068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:34.296114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:34.296119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.296126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.296132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.296144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:34.296159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018096:10263], now have 1 active actors on pipe
2025-10-01T14:15:34.296164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540017935:2446], now have 1 active actors on pipe
2025-10-01T14:15:34.296169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.296171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.296172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.296181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:34.296190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:34.296198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:34.296200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:34.296201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:34.296202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:34.296202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:34.296225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.296233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:34.296252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:34.296232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2580
2025-10-01T14:15:34.296263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.296266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.296271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2580
2025-10-01T14:15:34.296283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b51d4700-703d50c6-591c3e24-6caf586f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:34.296291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.296294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.296296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:34.296301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.296307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:34.296322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.296487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.296499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.296540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.296633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2581 partition: 0 MaxSeqNo: 45 sessionId: src_id|b51d4700-703d50c6-591c3e24-6caf586f_0
2025-10-01T14:15:34.296952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826c91cc-65decd6c-c6b54cdd-d8fa6bd9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b51d4700-703d50c6-591c3e24-6caf586f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:34.299667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Write session: try to update token
2025-10-01T14:15:34.299684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:34.306742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:34.306759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.306769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.306800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:34.306815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:34.306977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:34.307105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.307233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.307355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.307530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:34.307566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:34.313585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId: src_id|b51d4700-703d50c6-591c3e24-6caf586f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:34.316005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:34.316192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.316213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.316251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:34.316332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:34.325204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:34.325222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.325225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:34.325227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:34.325239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.325244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.325248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256800163096971:7160]
2025-10-01T14:15:34.325291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:34.325299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:34.325302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:34.325306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:34.325306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.325309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:34.325460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:34.376497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256802540018108:3353]
2025-10-01T14:15:34.376772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2580, pipe: [1:7556256802540018108:3353]
2025-10-01T14:15:34.485325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:34.493471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.493499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.493641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.493698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.493759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.493816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.493864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.493873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.493935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.493994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.494051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.494111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.494154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.494162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.494234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.494294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.494353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.494433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.494479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.494489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.494556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.494617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.494680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.494784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.494827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.494835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.494897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.494971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.495041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.495102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.495150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.495160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.495225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.495284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.495345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.495411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.495459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.495466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.495531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.495589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.495736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.495801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.495860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.495866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.495936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.495998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.496061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.496124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.496172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.496179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.496247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.496311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.496374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.496512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.496651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.496659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.496722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.496789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.496859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.496920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.496969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.496978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.497036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018108:3353], now have 1 active actors on pipe
2025-10-01T14:15:34.497250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256802540018108:3353]
2025-10-01T14:15:34.497252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:34.497256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:34.497280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:34.497283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2581 reason: error at write: Disconnected sessionId: src_id|b51d4700-703d50c6-591c3e24-6caf586f_0
2025-10-01T14:15:34.497483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2581 sessionId: src_id|b51d4700-703d50c6-591c3e24-6caf586f_0 is DEAD
2025-10-01T14:15:34.497640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:34.497660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Write session will restart in 0.009619s
2025-10-01T14:15:34.497685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Write session: Do CDS request
2025-10-01T14:15:34.497691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:34.498093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:34.508935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.509014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:34.509028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2582
2025-10-01T14:15:34.509170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.509202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:34.509211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:34.509214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:34.509365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:34.509584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2582 sessionId:  describe result for acl check
2025-10-01T14:15:34.509615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:34.509620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:34.509621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:34.509624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256802540018243:10259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:34.510138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256802540018243:10259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:34.511631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:34.511915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:34.511928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:34.511943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:34.512020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:34.512059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256800163097145:7154]
2025-10-01T14:15:34.512351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256802540018243:10259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:34.512610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:34.512840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:34.512869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:34.513088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:34.513126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.513131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.513131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.513132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.513133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.513134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.513134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.513135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.513136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.513136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.513137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.513138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.513138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.513139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.513143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.513149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.513151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.513153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.513155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.513158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.513160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.513162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.513164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.513167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.513169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.513171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.513173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.513175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.513179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.513184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.513188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.513191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.513194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.513196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.513199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.513202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.513204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.513207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.513209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.513212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.513214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.513217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.513219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.513222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.513225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.513228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.513230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.513233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.513236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.513239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.513241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.513244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.513247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.513250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.513252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.513255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.513275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:34.516585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256802540018243:10259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:34.516606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256802540018243:10259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:34.516609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256802540018243:10259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:34.516616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:34.516764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:34.517718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2581
2025-10-01T14:15:34.517739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2581
2025-10-01T14:15:34.517360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:34.517378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:34.517380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:34.517384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:34.517391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2581 [2:7556256800163097145:7154]
2025-10-01T14:15:34.517406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:34.517422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:34.517424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.517427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.517429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.517445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:34.517451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:34.517457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:34.517512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.517514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.517516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.517519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:34.517521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:34.517594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:34.517597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.517607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.517616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.517625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:34.517639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018282:10259], now have 1 active actors on pipe
2025-10-01T14:15:34.517641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018113:2446], now have 1 active actors on pipe
2025-10-01T14:15:34.517646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.517647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.517649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.517659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:34.517668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:34.517672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:34.517676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:34.517677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:34.517678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:34.517679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:34.517701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.517707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:34.517711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:34.517743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.517747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.517774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67373a65-b26533-93f080f5-d36238b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:34.517780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.517784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.517786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:34.517795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.517803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:34.517816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.517951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.517958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.517980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.518052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2582 partition: 0 MaxSeqNo: 45 sessionId: src_id|67373a65-b26533-93f080f5-d36238b3_0
2025-10-01T14:15:34.518421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51d4700-703d50c6-591c3e24-6caf586f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67373a65-b26533-93f080f5-d36238b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:34.521287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Write session: try to update token
2025-10-01T14:15:34.521307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:34.528653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:34.528666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.528678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.528712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:34.528720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:34.528890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:34.529031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.529177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.529334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.529531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:34.529580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:34.535588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId: src_id|67373a65-b26533-93f080f5-d36238b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:34.538009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:34.538233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.538400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:34.538268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.538307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:34.548247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:34.548266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.548268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:34.548270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:34.548282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.548286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.548290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256800163097140:7154]
2025-10-01T14:15:34.548343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:34.548345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:34.548350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.548352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:34.548353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:34.548356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:34.548498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:34.597682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256802540018292:3353]
2025-10-01T14:15:34.597957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2581, pipe: [1:7556256802540018292:3353]
2025-10-01T14:15:34.692304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:34.700836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.700865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.701009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.701065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.701121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.701173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.701288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.701298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.701356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.701418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.701502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.701584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.701625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.701630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.701689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.701743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.701801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.701862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.701907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.701919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.701991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.702055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.702115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.702179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.702222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.702228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.702293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.702355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.702436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.702499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.702540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.702551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.702626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.702690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.702751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.702813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.702868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.702877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.702950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.703017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.703081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.703139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.703180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.703187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.703256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.703316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.703374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.703441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.703492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.703500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.703630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.703686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.703742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.703797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.703837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.703843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.703903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.703959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.704023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.704077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.704121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.704127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.704187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018292:3353], now have 1 active actors on pipe
2025-10-01T14:15:34.704425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256802540018292:3353]
2025-10-01T14:15:34.704436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:34.704440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:34.704459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:34.704467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2582 reason: error at write: Disconnected sessionId: src_id|67373a65-b26533-93f080f5-d36238b3_0
2025-10-01T14:15:34.704757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2582 sessionId: src_id|67373a65-b26533-93f080f5-d36238b3_0 is DEAD
2025-10-01T14:15:34.704847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:34.704859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Write session will restart in 0.005137s
2025-10-01T14:15:34.704881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Write session: Do CDS request
2025-10-01T14:15:34.704885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:34.705320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:34.710917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.711050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:34.711067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2583
2025-10-01T14:15:34.711173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.711204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:34.711215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:34.711220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:34.711623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2583 sessionId:  describe result for acl check
2025-10-01T14:15:34.711662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:34.711680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:34.711685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:34.711690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256802540018326:10247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:34.712220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256802540018326:10247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:34.715287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256802540018326:10247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:34.717600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:34.717703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256802540018326:10247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:34.717717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256802540018326:10247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:34.717720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256802540018326:10247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:34.717727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:34.719693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:34.719945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:34.719957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:34.719968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:34.720023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:34.720074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256800163097327:7156]
2025-10-01T14:15:34.720599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:34.720861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:34.720892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:34.721097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:34.721132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.721136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.721137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.721138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.721138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.721139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.721139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.721140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.721141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.721141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.721142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.721143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.721143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.721144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.721147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.721153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.721155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.721158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.721160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.721162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.721164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.721166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.721168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.721170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.721172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.721174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.721177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.721179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.721184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.721188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.721192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.721195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.721198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.721201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.721203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.721206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.721209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.721212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.721214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.721216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.721219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.721222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.721224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.721226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.721229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.721232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.721234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.721237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.721239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.721242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.721244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.721248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.721250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.721252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.721254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.721257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.721281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:34.724869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:34.725482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:34.725498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:34.725501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:34.725503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:34.725509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2582 [2:7556256800163097327:7156]
2025-10-01T14:15:34.725526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:34.725542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:34.725544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.725547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.725550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.725562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:34.725571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:34.725576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:34.725627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.725633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.725634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.725637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:34.725639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:34.725689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:34.725694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.725702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.725707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.725715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:34.725730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.725734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.725735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.725741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:34.725751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:34.725751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:34.725754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:34.725756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:34.725759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:34.725761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:34.725782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018465:10247], now have 1 active actors on pipe
2025-10-01T14:15:34.725787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018300:2446], now have 1 active actors on pipe
2025-10-01T14:15:34.725789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.725794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:34.725804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:34.725932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2582
2025-10-01T14:15:34.725932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2582
2025-10-01T14:15:34.726044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.726053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.726077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:34.726089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.726097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.726103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:34.726111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.726123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:34.726139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.726318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.726323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.726333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.726411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2583 partition: 0 MaxSeqNo: 45 sessionId: src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0
2025-10-01T14:15:34.726753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67373a65-b26533-93f080f5-d36238b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:34.729360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Write session: try to update token
2025-10-01T14:15:34.729377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:34.737827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:34.737850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.737862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.737910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:34.737912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:34.738095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:34.738247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.738436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.738591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.738802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:34.738852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:34.744943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId: src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:34.747987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:34.748261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.748283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.748323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:34.748407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:34.757357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:34.757374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.757376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:34.757378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:34.757389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.757393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.757398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256800163097321:7156]
2025-10-01T14:15:34.757435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:34.757444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:34.757446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:34.757450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:34.757450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.757452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:34.757575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:34.809241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256802540018477:3353]
2025-10-01T14:15:34.809777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2582, pipe: [1:7556256802540018477:3353]
2025-10-01T14:15:34.919021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:34.927786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.927817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.928004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.928067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.928145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.928205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.928252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.928256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.928335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.928398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.928462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.928548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.928594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.928598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.928677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.928742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.928812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.928881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.928924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.928927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.929000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.929069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.929141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.929207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.929254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.929258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.929333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.929401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.929481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.929555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.929669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.929672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.929753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.929821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.929898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.929969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.930023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.930026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.930103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.930167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.930233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.930303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.930399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.930403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.930476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.930542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.930608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.930673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.930750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.930753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.930826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.930882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.930954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.931019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.931062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.931066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.931138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:34.931205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:34.931268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:34.931937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256802540018477:3353]
2025-10-01T14:15:34.931979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:34.931982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:34.932021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2583 reason: error at write: Disconnected sessionId: src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0
2025-10-01T14:15:34.932200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:34.932231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2583 sessionId: src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0 is DEAD
2025-10-01T14:15:34.931331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:34.931388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:34.931392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:34.931475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018477:3353], now have 1 active actors on pipe
2025-10-01T14:15:34.932842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:34.934483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:34.934497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Write session will restart in 0.008777s
2025-10-01T14:15:34.934531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Write session: Do CDS request
2025-10-01T14:15:34.934538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:34.944868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.944980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:34.944994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2584
2025-10-01T14:15:34.945098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:34.945145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:34.945164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:34.945168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:34.945516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2584 sessionId:  describe result for acl check
2025-10-01T14:15:34.945546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:34.945547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:34.945548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:34.945552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256802540018587:5384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:34.945954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256802540018587:5384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:34.948550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256802540018587:5384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:34.949167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:34.951847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:34.952068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:34.952083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:34.952096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:34.952153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:34.951819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256802540018587:5384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:34.951834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256802540018587:5384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:34.951838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256802540018587:5384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:34.951848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:34.952213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256800163097507:7145]
2025-10-01T14:15:34.952783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:34.953075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:34.953116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:34.953392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:34.953453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.953459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.953460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.953461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.953462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.953463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.953465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.953466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.953467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.953468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.953469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.953470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.953471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.953472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.953477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.953486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.953489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.953493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.953496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.953499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.953503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.953506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.953510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.953513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.953517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.953520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.953523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.953526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.953533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.953540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:34.953545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.953550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:34.953555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.953559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:34.953563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.953568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:34.953573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.953582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:34.953586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.953590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:34.953596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.953601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:34.953608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.953613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:34.953617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.953621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:34.953628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.953632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.953636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.953641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.953648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.953651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.953655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.953659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:34.953667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.953671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:34.953706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:34.957347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:34.958344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:34.958359Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:34.958361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:34.958364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:34.958387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2583 [2:7556256800163097507:7145]
2025-10-01T14:15:34.958404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:34.958421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:34.958429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.958433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.958435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.958451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:34.958456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:34.958462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:34.958517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.958525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.958538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.958542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:34.958545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:34.958612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:34.958620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.958630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:34.958640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:34.958656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:34.958677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018668:5384], now have 1 active actors on pipe
2025-10-01T14:15:34.958684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256802540018505:2446], now have 1 active actors on pipe
2025-10-01T14:15:34.958692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.958694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.958697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.958709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:34.958719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:34.958722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:34.958724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:34.958725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:34.958739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:34.958742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:34.958767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.958777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:34.958785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:34.959092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2583
2025-10-01T14:15:34.959126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2583
2025-10-01T14:15:34.959149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.959160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.959190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:34.959202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:34.959207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:34.959211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:34.959222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:34.959246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:34.959265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.959417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.959424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.959438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:34.959508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2584 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0
2025-10-01T14:15:34.959859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d8d1cd-44ebd12c-665a3764-379d9614_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:34.962983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Write session: try to update token
2025-10-01T14:15:34.963001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:34.969975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:34.969997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.970007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.970052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:34.970066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:34.970395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:34.970547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.970692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.970854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:34.971045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:34.971092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:34.977340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId: src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:34.979773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:34.979958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:34.979978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:34.980016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:34.980109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:34.989662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:34.989680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:34.989683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:34.989685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:34.989696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.989700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.989704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256800163097502:7145]
2025-10-01T14:15:34.989750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:34.989752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:34.989754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:34.989757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:34.989759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:34.989761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:34.989886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:35.032369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256806834985979:3353]
2025-10-01T14:15:35.032631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2583, pipe: [1:7556256806834985979:3353]
2025-10-01T14:15:35.136237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:35.144491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.144535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.144711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.144784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.144856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.144924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.144969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.144979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.145052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.145111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.145174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.145236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.145282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.145290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.145360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.145422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.145488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.145558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.145602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.145611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.145680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.145743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.145807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.145874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.145922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.145928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.145992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.146056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.146119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.146182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.146224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.146232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.146301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.146360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.146444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.146510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.146570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.146577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.146645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.146706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.146773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.146837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.146883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.146889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.146956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.147019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.147079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.147137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.147182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.147190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.147258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.147317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.147375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.147452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.147498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.147503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.147562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.147616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.147671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.147728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.147771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.147776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.147832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834985979:3353], now have 1 active actors on pipe
2025-10-01T14:15:35.148066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256806834985979:3353]
2025-10-01T14:15:35.148077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:35.148081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:35.148107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2584 reason: error at write: Disconnected sessionId: src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0
2025-10-01T14:15:35.148109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:35.148289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2584 sessionId: src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0 is DEAD
2025-10-01T14:15:35.148446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:35.148454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Write session will restart in 0.006494s
2025-10-01T14:15:35.148481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Write session: Do CDS request
2025-10-01T14:15:35.148487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:35.148967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:35.155920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.155981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:35.155994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2585
2025-10-01T14:15:35.156118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.156150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:35.156159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:35.156162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:35.156591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2585 sessionId:  describe result for acl check
2025-10-01T14:15:35.156631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:35.156637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:35.156639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:35.156646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256806834986041:5390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:35.157198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256806834986041:5390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:35.159711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256806834986041:5390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:35.161452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:35.163848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:35.164083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:35.164094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:35.164105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:35.164151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:35.164191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256804458064975:7143]
2025-10-01T14:15:35.164797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:35.164949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256806834986041:5390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:35.164971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256806834986041:5390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:35.164974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256806834986041:5390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:35.164982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:35.165196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:35.165237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:35.165558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:35.165607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.165613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.165614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.165615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.165616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.165617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.165618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.165620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.165621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.165622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.165623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.165624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.165625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.165626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.165631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.165640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.165644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.165648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.165651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.165655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.165659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.165662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.165666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.165670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.165674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.165678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.165681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.165685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.165691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.165698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.165703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.165709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.165713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.165717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.165721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.165726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.165731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.165736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.165740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.165745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.165750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.165756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.165760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.165764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.165768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.165772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.165777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.165782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.165790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.165795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.165799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.165803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.165808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.165816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.165820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.165825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.165857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:35.169490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:35.170188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:35.170201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:35.170204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:35.170207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:35.170215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2584 [2:7556256804458064975:7143]
2025-10-01T14:15:35.170231Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:35.170249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:35.170256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.170260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.170262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.170277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:35.170288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:35.170294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:35.170345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.170350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.170351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.170353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:35.170355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:35.170434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:35.170442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.170453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.170463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.170477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:35.170498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986168:5390], now have 1 active actors on pipe
2025-10-01T14:15:35.170506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834985997:2446], now have 1 active actors on pipe
2025-10-01T14:15:35.170513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.170516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.170518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.170535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:35.170556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:35.170569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:35.170572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:35.170586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:35.170590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:35.170592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:35.170603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.170606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:35.170617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:35.170648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.170652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.170676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a48630a9-687824be-1aca8874-7f745fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:35.170683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.170686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.170689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:35.170697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.170705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:35.170717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.171077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.171090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.171111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.171605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c12ae1-d896e63a-e524f2fc-3859b6ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a48630a9-687824be-1aca8874-7f745fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:35.174246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Write session: try to update token
2025-10-01T14:15:35.174265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:35.170607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2584
2025-10-01T14:15:35.170625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2584
2025-10-01T14:15:35.171201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2585 partition: 0 MaxSeqNo: 45 sessionId: src_id|a48630a9-687824be-1aca8874-7f745fc_0
2025-10-01T14:15:35.181554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:35.181574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:35.181584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.181626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:35.181629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:35.181784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:35.181922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:35.182050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:35.182247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:35.182446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:35.182484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:35.187805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId: src_id|a48630a9-687824be-1aca8874-7f745fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:35.190507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:35.190793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.190814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.190851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:35.190921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:35.202745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:35.202768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:35.202771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:35.202773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:35.202783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.202787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.202791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256804458064970:7143]
2025-10-01T14:15:35.202832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:35.202846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:35.202847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:35.202849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:35.202855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.202858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:35.202993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:35.248459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256806834986178:3353]
2025-10-01T14:15:35.248753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2584, pipe: [1:7556256806834986178:3353]
2025-10-01T14:15:35.357041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:35.364507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.364541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.364697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.364753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.364815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.364880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.364924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.364933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.364998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.365061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.365119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.365183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.365229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.365236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.365305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.365365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.365431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.365493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.365535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.365542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.365608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.365675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.365744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.365804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.365846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.365853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.365915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.365973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.366028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.366087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.366131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.366138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.366201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.366259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.366319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.366396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.366441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.366448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.366512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.366569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.366629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.366691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.366732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.366740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.366801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.366860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.366922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.366987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.367028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.367035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.367098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.367160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.367222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.367286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.367329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.367340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.367404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:35.367460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:35.367522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:35.367581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:35.367622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:35.367628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:35.367690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986178:3353], now have 1 active actors on pipe
2025-10-01T14:15:35.367923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256806834986178:3353]
2025-10-01T14:15:35.367927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:35.367931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:35.367955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:35.367957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2585 reason: error at write: Disconnected sessionId: src_id|a48630a9-687824be-1aca8874-7f745fc_0
2025-10-01T14:15:35.368135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2585 sessionId: src_id|a48630a9-687824be-1aca8874-7f745fc_0 is DEAD
2025-10-01T14:15:35.368277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:35.368288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Write session will restart in 0.009810s
2025-10-01T14:15:35.368314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Write session: Do CDS request
2025-10-01T14:15:35.368319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:35.368842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:35.378882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.378887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:35.378905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2586
2025-10-01T14:15:35.379133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.379168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:35.379177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:35.379181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:35.379552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2586 sessionId:  describe result for acl check
2025-10-01T14:15:35.379583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:35.379589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:35.379590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:35.379595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256806834986315:5399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:35.380101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256806834986315:5399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:35.380387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:35.381710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256806834986315:5399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:35.382598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:35.382805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:35.382816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:35.382828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:35.382878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:35.382918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256804458065178:7131]
2025-10-01T14:15:35.383474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:35.383802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:35.383835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:35.384122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:35.384174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.384180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.384181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.384183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.384184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.384185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.384186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.384188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.384189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.384190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.384192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.384193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.384194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.384195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.384200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.384209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.384213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.384217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.384220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.384224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.384227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.384230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.384233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.384237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.384240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.384244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.384247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.384253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.384259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.384254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256806834986315:5399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:35.384266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256806834986315:5399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:35.384267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.384268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256806834986315:5399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:35.384275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:35.384282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.384287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.384291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.384296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.384300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.384305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.384309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.384314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.384318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.384323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.384333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.384338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.384342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.384348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.384353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.384362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.384366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.384370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.384375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.384384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.384388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.384394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.384402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.384406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.384414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.384419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.384464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:35.388201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:35.389171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:35.389187Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:35.389190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:35.389194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:35.389201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2585 [2:7556256804458065178:7131]
2025-10-01T14:15:35.389217Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:35.389236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:35.389244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.389247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.389250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.389265Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:35.389271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:35.389277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:35.389335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.389342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.389344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.389347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:35.389360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:35.389432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:35.389438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.389446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.389452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.389462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:35.389481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986351:5399], now have 1 active actors on pipe
2025-10-01T14:15:35.389484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986183:2446], now have 1 active actors on pipe
2025-10-01T14:15:35.389491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.389493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.389495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.389506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:35.389518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:35.389520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:35.389526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:35.389529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:35.389534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:35.389537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:35.389545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2585
2025-10-01T14:15:35.389546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2585
2025-10-01T14:15:35.389569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.389581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:35.389583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:35.389606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.389610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.389640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66e4925b-73e956c9-86d7e38e-4570449_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:35.389647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.389651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.389653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:35.389663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.389671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:35.389690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.389802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.389811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.389827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.389891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2586 partition: 0 MaxSeqNo: 45 sessionId: src_id|66e4925b-73e956c9-86d7e38e-4570449_0
2025-10-01T14:15:35.390249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48630a9-687824be-1aca8874-7f745fc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66e4925b-73e956c9-86d7e38e-4570449_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:35.393063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Write session: try to update token
2025-10-01T14:15:35.393082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:35.409405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId: src_id|66e4925b-73e956c9-86d7e38e-4570449_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:35.411981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:35.412955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.412985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.413007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:35.413015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:35.413017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:35.413019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:35.413028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.413032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.413037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256804458065173:7131]
2025-10-01T14:15:35.413082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:35.413090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:35.413097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.413099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:35.413100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:35.413108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:35.413263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:35.468061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256806834986361:3353]
2025-10-01T14:15:35.468306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2585, pipe: [1:7556256806834986361:3353]
2025-10-01T14:15:35.562704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:35.563146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:35.563203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986361:3353], now have 1 active actors on pipe
2025-10-01T14:15:35.564052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:35.564147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:35.564149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:35.564222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2586 reason: error at write: Disconnected sessionId: src_id|66e4925b-73e956c9-86d7e38e-4570449_0
2025-10-01T14:15:35.564366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2586 sessionId: src_id|66e4925b-73e956c9-86d7e38e-4570449_0 is DEAD
2025-10-01T14:15:35.564541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256806834986361:3353]
2025-10-01T14:15:35.564554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:35.566726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:35.566739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Write session will restart in 0.006271s
2025-10-01T14:15:35.566768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Write session: Do CDS request
2025-10-01T14:15:35.566789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:35.573904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.573974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:35.573997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2587
2025-10-01T14:15:35.578615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.578669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:35.578675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:35.578679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:35.579111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2587 sessionId:  describe result for acl check
2025-10-01T14:15:35.579153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:35.579154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:35.579158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:35.579163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256806834986409:5410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:35.579638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256806834986409:5410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:35.584771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256806834986409:5410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:35.589365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:35.589435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256806834986409:5410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:35.589452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256806834986409:5410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:35.589455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256806834986409:5410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:35.589475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:35.594154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:35.594507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:35.594521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:35.594538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:35.594618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:35.594667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256804458065352:7123]
2025-10-01T14:15:35.595323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:35.595733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:35.595790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:35.596122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:35.596191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.596197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.596198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.596199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.596201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.596202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.596204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.596206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.596207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.596208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.596210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.596211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.596212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.596214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.596219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.596229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.596234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.596239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.596244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.596248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.596251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.596255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.596260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.596265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.596269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.596274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.596277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.596281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.596289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.596297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.596304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.596315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.596320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.596329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.596338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.596345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.596353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.596363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.596370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.596376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.596385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.596393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.596398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.596403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.596411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.596418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.596426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.596435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.596440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.596449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.596454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.596463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.596469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.596476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.596484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.596493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.596545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:35.601899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2586
2025-10-01T14:15:35.601916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2586
2025-10-01T14:15:35.602357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2587 partition: 0 MaxSeqNo: 45 sessionId: src_id|820f517d-10b9a47f-3ea39848-3d32926b_0
2025-10-01T14:15:35.600761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:35.601361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:35.601367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:35.601370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:35.601374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:35.601381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2586 [2:7556256804458065352:7123]
2025-10-01T14:15:35.601399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:35.601418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:35.601422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.601425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.601428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.601444Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:35.601450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:35.601457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:35.601516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.601518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.601521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.601525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:35.601528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:35.601600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:35.601603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.601614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.601624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.601640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:35.601657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.601661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.601662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.601679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:35.601694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:35.601707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:35.601710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:35.601745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.601747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:35.601782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986535:5410], now have 1 active actors on pipe
2025-10-01T14:15:35.601786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986366:2446], now have 1 active actors on pipe
2025-10-01T14:15:35.601869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:35.601872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:35.601877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:35.601884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:35.602044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.602052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.602082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|820f517d-10b9a47f-3ea39848-3d32926b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:35.602091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.602095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.602097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:35.602110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.602121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:35.602136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.602266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.602269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.602282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.602758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4925b-73e956c9-86d7e38e-4570449_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|820f517d-10b9a47f-3ea39848-3d32926b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:35.605470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Write session: try to update token
2025-10-01T14:15:35.605491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:35.625687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId: src_id|820f517d-10b9a47f-3ea39848-3d32926b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:35.628215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:35.629828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.629854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.629876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:35.629880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:35.629882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:35.629885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:35.629896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.629903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.629910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256804458065346:7123]
2025-10-01T14:15:35.629946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:35.629960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:35.629965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:35.629972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:35.629983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.629986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:35.630167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:35.663137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256806834986553:3353]
2025-10-01T14:15:35.663382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2586, pipe: [1:7556256806834986553:3353]
2025-10-01T14:15:35.790030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:35.790531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:35.790584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986553:3353], now have 1 active actors on pipe
2025-10-01T14:15:35.790610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:35.790743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256806834986553:3353]
2025-10-01T14:15:35.790761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:35.801330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:35.801343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:35.801363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2587 reason: error at write: Disconnected sessionId: src_id|820f517d-10b9a47f-3ea39848-3d32926b_0
2025-10-01T14:15:35.801473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2587 sessionId: src_id|820f517d-10b9a47f-3ea39848-3d32926b_0 is DEAD
2025-10-01T14:15:35.801597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:35.801614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Write session will restart in 0.009636s
2025-10-01T14:15:35.801640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Write session: Do CDS request
2025-10-01T14:15:35.801650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:35.807656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:35.810260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:35.810512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:35.810527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:35.810540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:35.810602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:35.810643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256804458065539:7117]
2025-10-01T14:15:35.811251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:35.811565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:35.811605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:35.811907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:35.811964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.811969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.811970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.811971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.811972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.811974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.811975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.811977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.811978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.811979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.811980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.811982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.811983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.811984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.811990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.811999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.812003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.812007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.812011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.812015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.812019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.812022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.812026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.812030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.812034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.812037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.812040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.812043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.812050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.812058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:35.812065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.812070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:35.812075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.812079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:35.812088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.812093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:35.812097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.812103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:35.812107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.812116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:35.812121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.812125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:35.812133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.812138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:35.812143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.812152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:35.812158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.812166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.812170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.812175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.812182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.812187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.812194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.812198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:35.812202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.812207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:35.812245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:35.813039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.813098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:35.813114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2588
2025-10-01T14:15:35.813255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.813288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:35.813294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:35.813299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:35.813707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2588 sessionId:  describe result for acl check
2025-10-01T14:15:35.813745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:35.813746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:35.813748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:35.813753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256806834986724:5418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:35.814274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256806834986724:5418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:35.816210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:35.816558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256806834986724:5418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:35.816886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:35.816902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:35.816904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:35.816908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:35.816916Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2587 [2:7556256804458065539:7117]
2025-10-01T14:15:35.816931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:35.816952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:35.816960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.816964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.816967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.816985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:35.816996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:35.817002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:35.817061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.817068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.817071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.817074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:35.817077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:35.817155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:35.817163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.817175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:35.817192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:35.817215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:35.817238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986573:2446], now have 1 active actors on pipe
2025-10-01T14:15:35.817251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.817258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.817260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.817276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:35.817296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:35.817298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:35.817291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2587
2025-10-01T14:15:35.817302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:35.817305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:35.817316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:35.817323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:35.817362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.817369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:35.817387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:35.822386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256806834986724:5418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:35.822403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256806834986724:5418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:35.822407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256806834986724:5418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:35.822416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:35.822651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986761:5418], now have 1 active actors on pipe
2025-10-01T14:15:35.822681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2587
2025-10-01T14:15:35.822761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.822777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.822805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:35.822831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:35.822842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:35.822845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:35.822858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:35.822874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:35.822898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.823095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.823109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.823132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:35.823229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2588 partition: 0 MaxSeqNo: 45 sessionId: src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0
2025-10-01T14:15:35.823615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f517d-10b9a47f-3ea39848-3d32926b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:35.826522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Write session: try to update token
2025-10-01T14:15:35.826543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:35.840839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:35.840864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:35.840868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:35.840870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:35.840881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.840887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.840892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256804458065533:7117]
2025-10-01T14:15:35.840944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:35.840949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:35.840957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:35.840960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:35.840961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:35.840965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:35.841103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:35.841929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId: src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:35.844969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:35.890973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256806834986765:3353]
2025-10-01T14:15:35.891192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2587, pipe: [1:7556256806834986765:3353]
2025-10-01T14:15:35.990961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:35.991396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:35.991414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:35.991458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986765:3353], now have 1 active actors on pipe
2025-10-01T14:15:35.991684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:35.991661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256806834986765:3353]
2025-10-01T14:15:35.991692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:35.991695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:35.991755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2588 reason: error at write: Disconnected sessionId: src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0
2025-10-01T14:15:35.991930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2588 sessionId: src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0 is DEAD
2025-10-01T14:15:35.992046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:35.992116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:35.992126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Write session will restart in 0.005160s
2025-10-01T14:15:35.992154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Write session: Do CDS request
2025-10-01T14:15:35.992160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:35.998896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.998953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:35.998967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2589
2025-10-01T14:15:35.999126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:35.999160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:35.999168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:35.999172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:35.999759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2589 sessionId:  describe result for acl check
2025-10-01T14:15:35.999792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:35.999793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:35.999795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:35.999800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256806834986817:5444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:36.000287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256806834986817:5444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:36.004367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256806834986817:5444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:36.006179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:36.009127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256806834986817:5444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:36.009145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256806834986817:5444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:36.009150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256806834986817:5444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:36.009158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:36.010515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:36.010784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:36.010800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:36.010814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:36.010876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:36.010919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256808753033021:7112]
2025-10-01T14:15:36.011526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:36.011909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:36.011965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:36.012280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:36.012360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.012368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.012369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.012370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.012372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.012373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.012374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.012375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.012376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.012377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.012378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.012380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.012381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.012381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.012387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.012398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.012401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.012405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.012409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.012413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.012417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.012420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.012424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.012428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.012431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.012435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.012438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.012442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.012449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.012456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.012463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.012468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.012471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.012476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.012480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.012486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.012490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.012495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.012500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.012504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.012509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.012519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.012533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.012538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.012543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.012554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.012562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.012567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.012577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.012581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.012585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.012594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.012603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.012612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.012621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.012630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.012666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:36.016808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:36.017559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:36.017574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:36.017577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:36.017580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:36.017587Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2588 [2:7556256808753033021:7112]
2025-10-01T14:15:36.017606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:36.017622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:36.017625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.017628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.017631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.017648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:36.017658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:36.017665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:36.017734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.017741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.017743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.017747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:36.017749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:36.017823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:36.017831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.017844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.017858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.017877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:36.017901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256806834986792:2446], now have 1 active actors on pipe
2025-10-01T14:15:36.017910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954257:5444], now have 1 active actors on pipe
2025-10-01T14:15:36.017918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.017921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.017923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.017937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:36.017951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:36.017962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:36.017965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:36.017965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:36.017967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:36.017968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:36.017963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2588
2025-10-01T14:15:36.017973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2588
2025-10-01T14:15:36.018004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.018015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:36.018025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:36.018046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.018055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.018088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:36.018101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.018105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.018107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:36.018118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.018126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:36.018148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.018315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.018324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.018338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.018430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2589 partition: 0 MaxSeqNo: 45 sessionId: src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0
2025-10-01T14:15:36.018765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc62d2-7b0ba882-73cabf86-c7817d4e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:36.021236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Write session: try to update token
2025-10-01T14:15:36.021250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:36.034133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId: src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:36.036555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:36.036734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.036761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.038943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:36.038978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:36.038986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:36.038988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:36.038990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:36.038999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.039008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.039012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256808753033015:7112]
2025-10-01T14:15:36.039042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:36.039053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:36.039056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:36.039060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:36.039060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.039062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:36.039078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:36.039197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:36.091694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256811129954270:3353]
2025-10-01T14:15:36.092005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2588, pipe: [1:7556256811129954270:3353]
2025-10-01T14:15:36.184965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:36.192127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.192154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.192303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.192365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.192427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.192492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.193030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.193041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.193102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.193152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.193208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.193275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.193319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.193326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.193386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.193439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.193487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.193544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.193585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.193592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.193650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.193704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.193755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.193812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.193851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.193860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.193916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.194010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.194067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.194121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.194162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.194169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.194233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.194291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.194358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.194450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.194515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.194522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.194585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.194644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.194710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.194768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.194814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.194820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.194880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.194947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.195009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.195068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.195108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.195113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.195173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.195226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.195284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.195340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.195393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.195400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.195464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.195519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.195578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.195635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.195674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.195679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.195737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954270:3353], now have 1 active actors on pipe
2025-10-01T14:15:36.195984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:36.196018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:36.196022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:36.196027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256811129954270:3353]
2025-10-01T14:15:36.196049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2589 reason: error at write: Disconnected sessionId: src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0
2025-10-01T14:15:36.196216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:36.196261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2589 sessionId: src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0 is DEAD
2025-10-01T14:15:36.196362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:36.196372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Write session will restart in 0.009983s
2025-10-01T14:15:36.196397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Write session: Do CDS request
2025-10-01T14:15:36.196403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:36.207931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.207970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:36.207986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2590
2025-10-01T14:15:36.208135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.208167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:36.208172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:36.208175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:36.208550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2590 sessionId:  describe result for acl check
2025-10-01T14:15:36.208584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:36.208586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:36.208587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:36.208590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256811129954423:5458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:36.208628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:36.208955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256811129954423:5458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:36.210604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256811129954423:5458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:36.210953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:36.211146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:36.211158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:36.211170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:36.211218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:36.211262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256808753033196:7106]
2025-10-01T14:15:36.211812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:36.212120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:36.212161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:36.212221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256811129954423:5458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:36.212234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256811129954423:5458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:36.212237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256811129954423:5458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:36.212244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:36.212461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:36.212518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.212535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.212536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.212538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.212539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.212540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.212541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.212543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.212544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.212545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.212546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.212547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.212548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.212549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.212554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.212562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.212566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.212569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.212573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.212577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.212580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.212583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.212587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.212591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.212594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.212597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.212601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.212604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.212610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.212617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.212623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.212628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.212632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.212636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.212640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.212645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.212649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.212654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.212658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.212662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.212666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.212671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.212681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.212685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.212690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.212698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.212702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.212707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.212711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.212716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.212723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.212728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.212732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.212741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.212745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.212749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.212784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:36.216293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:36.217007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:36.217023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:36.217025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:36.217028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:36.217034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2589 [2:7556256808753033196:7106]
2025-10-01T14:15:36.217049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:36.217063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:36.217066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.217069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.217071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.217086Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:36.217090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:36.217096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:36.217151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.217159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.217161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.217164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:36.217166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:36.217226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:36.217232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.217242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.217256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.217274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:36.217294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954464:5458], now have 1 active actors on pipe
2025-10-01T14:15:36.217301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954285:2446], now have 1 active actors on pipe
2025-10-01T14:15:36.217308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.217310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.217312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.217328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:36.217344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:36.217353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:36.217361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:36.217363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:36.217363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:36.217365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:36.217387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.217391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:36.217400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:36.217374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2589
2025-10-01T14:15:36.217385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2589
2025-10-01T14:15:36.217421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.217430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.217459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:36.217480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.217488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.217491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:36.217499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.217511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:36.217528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.217739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.217749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.217766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.217855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2590 partition: 0 MaxSeqNo: 45 sessionId: src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0
2025-10-01T14:15:36.218186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5249fddd-b0b6bc64-fe40631d-2ca2e6fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:36.220637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Write session: try to update token
2025-10-01T14:15:36.220652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:36.233892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId: src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:36.236316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:36.237705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.237731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.237754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:36.237756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:36.237759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:36.237761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:36.237770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.237774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.237777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256808753033191:7106]
2025-10-01T14:15:36.237826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:36.237836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:36.237841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.237841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:36.237842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:36.237845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:36.237972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:36.295980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256811129954478:3353]
2025-10-01T14:15:36.296271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2589, pipe: [1:7556256811129954478:3353]
2025-10-01T14:15:36.385290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:36.385519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:36.385565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954478:3353], now have 1 active actors on pipe
2025-10-01T14:15:36.385661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:36.385726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256811129954478:3353]
2025-10-01T14:15:36.385757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:36.385759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:36.385761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:36.385844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2590 reason: error at write: Disconnected sessionId: src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0
2025-10-01T14:15:36.386004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2590 sessionId: src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0 is DEAD
2025-10-01T14:15:36.386119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:36.386128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Write session will restart in 0.006798s
2025-10-01T14:15:36.386152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Write session: Do CDS request
2025-10-01T14:15:36.386167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:36.393893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.394006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:36.394029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2591
2025-10-01T14:15:36.394144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.394178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:36.394188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:36.394192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:36.394707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2591 sessionId:  describe result for acl check
2025-10-01T14:15:36.394741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:36.394748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:36.394750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:36.394757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256811129954547:5464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:36.395282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256811129954547:5464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:36.397487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256811129954547:5464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:36.398731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:36.400917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:36.401120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:36.401130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:36.401141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:36.401186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:36.401222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256808753033404:7086]
2025-10-01T14:15:36.401321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256811129954547:5464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:36.401336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256811129954547:5464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:36.401340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256811129954547:5464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:36.401347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:36.401782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:36.402073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:36.402119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:36.402433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:36.402500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.402506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.402507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.402508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.402509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.402510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.402511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.402513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.402514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.402515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.402516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.402517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.402518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.402519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.402524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.402534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.402538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.402541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.402545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.402548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.402552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.402555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.402559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.402562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.402565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.402569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.402573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.402576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.402584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.402591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.402597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.402602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.402606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.402610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.402614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.402624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.402629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.402634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.402640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.402649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.402653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.402657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.402665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.402670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.402679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.402683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.402691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.402696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.402704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.402720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.402728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.402732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.402737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.402741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.402748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.402753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.402794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:36.406310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:36.407183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:36.407199Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:36.407201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:36.407206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:36.407213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2590 [2:7556256808753033404:7086]
2025-10-01T14:15:36.407229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:36.407245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:36.407254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.407257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.407259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.407273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:36.407279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:36.407284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:36.407340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.407347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.407348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.407353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:36.407355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:36.407439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:36.407446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.407456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.407466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.407483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:36.407504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954654:5464], now have 1 active actors on pipe
2025-10-01T14:15:36.407510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954483:2446], now have 1 active actors on pipe
2025-10-01T14:15:36.407517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.407519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.407520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.407531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2590
2025-10-01T14:15:36.407550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2590
2025-10-01T14:15:36.407534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:36.407550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:36.407550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:36.407552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:36.407554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:36.407563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:36.407565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:36.407597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.407608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:36.407613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:36.407621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.407625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.407667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:36.407679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.407687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.407689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:36.407702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.407713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:36.407732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.407949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.407959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.407976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.408087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2591 partition: 0 MaxSeqNo: 45 sessionId: src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0
2025-10-01T14:15:36.408508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87ca91-d957cd08-6153d6fb-d5d978f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:36.411055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Write session: try to update token
2025-10-01T14:15:36.411073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:36.425378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId: src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:36.427880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:36.428083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.428104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.428154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:36.428229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:36.430350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:36.430386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:36.430389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:36.430391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:36.430400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.430405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.430408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256808753033399:7086]
2025-10-01T14:15:36.430456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:36.430461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:36.430468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:36.430468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.430471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:36.430472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:36.430609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:36.485949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256811129954665:3353]
2025-10-01T14:15:36.486308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2590, pipe: [1:7556256811129954665:3353]
2025-10-01T14:15:36.580706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:36.589370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.589403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.589585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.589656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.589727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.589799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.589914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.589925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.590004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.590067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.590137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.590207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.590255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.590263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.590330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.590408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.590510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.590606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.590653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.590660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.590726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.590792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.590854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.590917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.590961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.590968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.591035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.591203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.591264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.591330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.591382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.591389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.591525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.591594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.591669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.591744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.591792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.591799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.591871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.593962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:36.593962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256811129954665:3353]
2025-10-01T14:15:36.593976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:36.593991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:36.594010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2591 reason: error at write: Disconnected sessionId: src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0
2025-10-01T14:15:36.594173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2591 sessionId: src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0 is DEAD
2025-10-01T14:15:36.594302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:36.594315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Write session will restart in 0.005829s
2025-10-01T14:15:36.594341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Write session: Do CDS request
2025-10-01T14:15:36.594347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:36.591937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.592011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.592071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.592645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.592653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.592720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.592777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.592841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.592906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.592950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.592953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.593028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.593088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.593149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.593217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.593257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.593259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.593328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.593388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.593454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.593515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.593561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.593564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.593632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954665:3353], now have 1 active actors on pipe
2025-10-01T14:15:36.594334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:36.600915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.600972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:36.600987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2592
2025-10-01T14:15:36.601132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.601167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:36.601185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:36.601193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:36.601594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2592 sessionId:  describe result for acl check
2025-10-01T14:15:36.601634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:36.601637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:36.601639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:36.601643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256811129954688:5476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:36.602154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256811129954688:5476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:36.605296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256811129954688:5476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:36.607899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256811129954688:5476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:36.607914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256811129954688:5476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:36.607917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256811129954688:5476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:36.607925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:36.609293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:36.611131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:36.611375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:36.611387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:36.611400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:36.611468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:36.611518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256808753033583:7080]
2025-10-01T14:15:36.612226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:36.612533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:36.612583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:36.612943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:36.613009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.613011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.613012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.613013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.613015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.613016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.613018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.613019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.613020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.613021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.613023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.613024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.613025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.613027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.613032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.613044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.613050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.613055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.613061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.613066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.613071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.613077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.613082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.613087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.613092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.613097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.613103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.613108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.613117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.613127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.613135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.613142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.613148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.613155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.613160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.613167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.613174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.613180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.613186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.613192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.613199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.613209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.613215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.613221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.613228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.613235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.613241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.613247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.613255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.613262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.613268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.613274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.613281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.613287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.613293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.613300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.613355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:36.617360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:36.618408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:36.618424Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:36.618427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:36.618430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:36.618436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2591 [2:7556256808753033583:7080]
2025-10-01T14:15:36.618453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:36.618471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:36.618474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.618478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.618480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.618495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:36.618501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:36.618506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:36.618566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.618576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.618578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.618581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:36.618583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:36.618652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:36.618661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.618673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.618683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.618698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:36.618715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954846:5476], now have 1 active actors on pipe
2025-10-01T14:15:36.618719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954673:2446], now have 1 active actors on pipe
2025-10-01T14:15:36.618730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.618733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.618735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.618749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:36.618760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:36.618763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:36.618765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:36.618768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:36.618781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:36.618784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:36.618824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.618833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:36.618810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2591
2025-10-01T14:15:36.618813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2591
2025-10-01T14:15:36.618853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:36.618870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.618879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.618914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:36.618926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.618930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.618932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:36.618942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.618950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:36.618970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.619174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.619183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.619198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.619299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2592 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0
2025-10-01T14:15:36.619651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1903584e-ccb25e15-4edbdbe7-ad91ccd4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:36.622086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Write session: try to update token
2025-10-01T14:15:36.622104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:36.635761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId: src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:36.638355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:36.640251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.640285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.640309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:36.640314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:36.640316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:36.640318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:36.640327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.640332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.640336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256808753033578:7080]
2025-10-01T14:15:36.640388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:36.640399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:36.640403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:36.640406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.640407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:36.640408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:36.640579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:36.694317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256811129954864:3353]
2025-10-01T14:15:36.694622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2591, pipe: [1:7556256811129954864:3353]
2025-10-01T14:15:36.783688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:36.783912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:36.783961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954864:3353], now have 1 active actors on pipe
2025-10-01T14:15:36.784043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:36.784113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256811129954864:3353]
2025-10-01T14:15:36.784141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:36.784184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:36.784191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:36.784204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2592 reason: error at write: Disconnected sessionId: src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0
2025-10-01T14:15:36.784380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2592 sessionId: src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0 is DEAD
2025-10-01T14:15:36.784476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:36.784488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Write session will restart in 0.005268s
2025-10-01T14:15:36.784513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Write session: Do CDS request
2025-10-01T14:15:36.784531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:36.790892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.791011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:36.791025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2593
2025-10-01T14:15:36.791142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:36.791181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:36.791190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:36.791194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:36.791623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2593 sessionId:  describe result for acl check
2025-10-01T14:15:36.791657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:36.791663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:36.791665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:36.791670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256811129954885:5481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:36.792176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256811129954885:5481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:36.794514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256811129954885:5481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:36.796794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256811129954885:5481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:36.796807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256811129954885:5481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:36.796810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256811129954885:5481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:36.796818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:36.797370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:36.799330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:36.799543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:36.799553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:36.799564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:36.799611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:36.799651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256808753033776:7072]
2025-10-01T14:15:36.800236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:36.800520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:36.800571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:36.800845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:36.800905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.800910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.800911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.800913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.800914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.800915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.800916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.800917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.800918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.800919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.800921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.800922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.800923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.800924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.800928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.800938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.800942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.800946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.800950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.800957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.800960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.800964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.800967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.800971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.800974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.800978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.800981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.800985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.800993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.801001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:36.801010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.801015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:36.801024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.801028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:36.801032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.801037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:36.801042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.801051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:36.801055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.801060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:36.801068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.801073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:36.801082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.801086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:36.801095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.801100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:36.801108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.801113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.801118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.801122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.801126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.801131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.801139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.801144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:36.801151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.801156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:36.801194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:36.807044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:36.807884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:36.807896Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:36.807898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:36.807902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:36.807908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2592 [2:7556256808753033776:7072]
2025-10-01T14:15:36.807924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:36.807944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:36.807950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.807952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.807954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.807967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:36.807976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:36.807981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:36.808034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.808040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.808041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.808045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:36.808047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:36.808100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:36.808106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.808113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:36.808119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:36.808128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:36.808143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.808151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.808153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.808159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:36.808169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:36.808168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:36.808171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:36.808173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:36.808178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:36.808180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:36.808187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129954868:2446], now have 1 active actors on pipe
2025-10-01T14:15:36.808191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129955042:5481], now have 1 active actors on pipe
2025-10-01T14:15:36.808220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.808231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:36.808243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:36.808333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2592
2025-10-01T14:15:36.808333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2592
2025-10-01T14:15:36.808385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.808393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.808413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:36.808425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:36.808430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:36.808432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:36.808441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:36.808450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:36.808463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.808620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.808628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.808641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:36.808711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2593 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0
2025-10-01T14:15:36.809055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0cd4-97d22cc5-e79d5a9c-2e016f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:36.811882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Write session: try to update token
2025-10-01T14:15:36.811903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:36.824901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:36.824921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:36.824933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.824984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:36.824985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:36.825167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:36.825375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:36.825525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:36.825684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:36.825875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:36.825921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:36.826286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId: src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:36.828846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:36.829135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.829163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.829200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:36.829283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:36.838100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:36.838119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:36.838121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:36.838124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:36.838135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.838139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.838143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256808753033769:7072]
2025-10-01T14:15:36.838190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:36.838203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:36.838209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:36.838355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:36.838502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:36.838516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:36.838520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:36.884241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256811129955056:3353]
2025-10-01T14:15:36.884485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2592, pipe: [1:7556256811129955056:3353]
2025-10-01T14:15:36.982424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:36.989317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:36.989342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:36.989473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.989525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.989578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.989628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.989667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.989674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.989729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.989787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.989837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.989891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.989933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.989938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.989996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.990050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.990104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.990161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.990200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.990205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.990262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.990315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.990389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.990453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.990492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.990497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.990551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.990606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.990659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.990712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.990755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.990756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.990814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.990866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.990920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.990973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.991028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.991033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.991089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.991137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.991191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.991244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.991284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.991290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.991357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.991410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.991467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.991523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.991564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.991570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.991629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.991681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.991734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.991789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.991826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.991831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.991889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:36.991954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:36.992014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:36.992071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:36.992113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:36.992118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:36.992156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129955056:3353], now have 1 active actors on pipe
2025-10-01T14:15:36.992403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256811129955056:3353]
2025-10-01T14:15:36.992435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:36.992472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:36.992479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:36.992512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2593 reason: error at write: Disconnected sessionId: src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0
2025-10-01T14:15:36.992770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2593 sessionId: src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0 is DEAD
2025-10-01T14:15:36.992950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:36.992963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Write session will restart in 0.008557s
2025-10-01T14:15:36.992990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Write session: Do CDS request
2025-10-01T14:15:36.992997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:36.993059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:37.002846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.002928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:37.002944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2594
2025-10-01T14:15:37.003047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.003093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:37.003106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:37.003109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:37.003516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2594 sessionId:  describe result for acl check
2025-10-01T14:15:37.003549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:37.003557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:37.003558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:37.003564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256815424922517:5502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:37.004069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256815424922517:5502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:37.004768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:37.005836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256815424922517:5502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:37.006890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:37.007070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:37.007081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:37.007093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:37.007141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:37.007180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256813048001260:7068]
2025-10-01T14:15:37.007778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:37.008058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:37.008107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:37.008304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256815424922517:5502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:37.008319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256815424922517:5502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:37.008322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256815424922517:5502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:37.008331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:37.008393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:37.008436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.008443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.008444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.008445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.008446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.008448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.008449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.008450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.008451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.008452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.008453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.008454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.008455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.008456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.008461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.008471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.008475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.008479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.008483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.008487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.008491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.008494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.008498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.008502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.008506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.008510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.008513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.008517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.008534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.008541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.008547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.008552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.008557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.008562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.008566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.008571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.008575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.008586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.008590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.008595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.008601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.008610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.008614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.008619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.008624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.008628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.008632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.008637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.008645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.008651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.008659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.008663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.008672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.008677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.008681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.008690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.008728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:37.012244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:37.013004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:37.013017Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:37.013019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:37.013022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:37.013029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2593 [2:7556256813048001260:7068]
2025-10-01T14:15:37.013045Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:37.013067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:37.013074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.013077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.013079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.013095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:37.013100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:37.013106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:37.013162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.013169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.013171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.013174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:37.013177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:37.013244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:37.013253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.013267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.013277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.013293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:37.013311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256811129955082:2446], now have 1 active actors on pipe
2025-10-01T14:15:37.013319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922554:5502], now have 1 active actors on pipe
2025-10-01T14:15:37.013326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.013328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.013331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.013345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:37.013362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:37.013363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:37.013366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:37.013368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:37.013380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:37.013383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:37.013408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.013415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:37.013397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2593
2025-10-01T14:15:37.013445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2593
2025-10-01T14:15:37.013429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:37.013474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.013483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.013506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51d7239-a422733d-ac643581-fd99a164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:37.013517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.013521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.013523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:37.013533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.013540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:37.013558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.013679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.013687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.013700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.013841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2594 partition: 0 MaxSeqNo: 45 sessionId: src_id|51d7239-a422733d-ac643581-fd99a164_0
2025-10-01T14:15:37.014195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c960c1f-80add80d-4b9ec2ea-7c2b64b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51d7239-a422733d-ac643581-fd99a164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:37.016788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Write session: try to update token
2025-10-01T14:15:37.016804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:37.024591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:37.024606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.024615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.024652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:37.024659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:37.024805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:37.024940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:37.025064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:37.025197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:37.025382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:37.025429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:37.030532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId: src_id|51d7239-a422733d-ac643581-fd99a164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:37.033109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:37.033594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.033618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.033655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:37.033820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:37.043033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:37.043053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.043055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:37.043057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:37.043068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.043072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.043077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256813048001255:7068]
2025-10-01T14:15:37.043114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:37.043120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:37.043125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:37.043126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.043129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:37.043132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:37.043249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:37.092642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256815424922566:3353]
2025-10-01T14:15:37.092908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2593, pipe: [1:7556256815424922566:3353]
2025-10-01T14:15:37.187958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:37.195678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.195711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.195868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.195932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.195989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.196056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.196107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.196117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.196205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.196271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.196330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.196397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.196441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.196445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.196511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.196592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.196650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.196701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.196744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.196752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.196817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.196877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.196936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.196990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.197031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.197040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.197097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.197150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.197207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.197266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.197307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.197314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.197372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.197429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.197491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.197584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.197627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.197633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.197691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.197749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.197807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.197865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.197924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.197931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.197989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.198044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.198100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.198160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.198199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.198205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.198262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.198315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.198392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.198454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.198495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.198501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.198559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.198615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.198670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.198724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.198767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.198775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.198842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922566:3353], now have 1 active actors on pipe
2025-10-01T14:15:37.199067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:37.199077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256815424922566:3353]
2025-10-01T14:15:37.199113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:37.199116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:37.199144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2594 reason: error at write: Disconnected sessionId: src_id|51d7239-a422733d-ac643581-fd99a164_0
2025-10-01T14:15:37.199323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2594 sessionId: src_id|51d7239-a422733d-ac643581-fd99a164_0 is DEAD
2025-10-01T14:15:37.199438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:37.199450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Write session will restart in 0.006004s
2025-10-01T14:15:37.199475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Write session: Do CDS request
2025-10-01T14:15:37.199482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:37.199961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:37.207340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.207573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:37.207593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2595
2025-10-01T14:15:37.207931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.207978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:37.207984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:37.207989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:37.208606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2595 sessionId:  describe result for acl check
2025-10-01T14:15:37.208651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:37.208652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:37.208656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:37.208661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256815424922640:5537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:37.209146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256815424922640:5537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:37.211740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256815424922640:5537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:37.213058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:37.215007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:37.215200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:37.215210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:37.215229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:37.215283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:37.215320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256813048001441:7062]
2025-10-01T14:15:37.215468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256815424922640:5537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:37.215483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256815424922640:5537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:37.215487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256815424922640:5537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:37.215495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:37.215888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:37.216289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:37.216321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:37.216530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:37.216570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.216574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.216575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.216576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.216577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.216577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.216578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.216579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.216579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.216580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.216581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.216582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.216582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.216583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.216586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.216592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.216595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.216597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.216599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.216601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.216603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.216605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.216607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.216609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.216612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.216614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.216616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.216618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.216623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.216628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.216632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.216635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.216638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.216641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.216643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.216647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.216649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.216652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.216655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.216658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.216661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.216665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.216670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.216675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.216680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.216685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.216690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.216695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.216699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.216703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.216705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.216708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.216711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.216714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.216717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.216720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.216741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:37.220365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:37.220947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:37.220962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:37.220965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:37.220968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:37.220975Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2594 [2:7556256813048001441:7062]
2025-10-01T14:15:37.220992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:37.221005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:37.221007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.221009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.221011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.221024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:37.221027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:37.221032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:37.221074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.221082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.221084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.221086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:37.221088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:37.221150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:37.221156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.221164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.221170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.221179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:37.221196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922583:2446], now have 1 active actors on pipe
2025-10-01T14:15:37.221202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922762:5537], now have 1 active actors on pipe
2025-10-01T14:15:37.221208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.221210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.221212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.221222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:37.221235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:37.221241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:37.221245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:37.221247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:37.221248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:37.221249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:37.221273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.221281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:37.221287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:37.221299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2594
2025-10-01T14:15:37.221305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2594
2025-10-01T14:15:37.221352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.221360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.221380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:37.221384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.221388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.221389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:37.221396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.221402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:37.221411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.221531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.221537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.221548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.221633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2595 partition: 0 MaxSeqNo: 45 sessionId: src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0
2025-10-01T14:15:37.222001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d7239-a422733d-ac643581-fd99a164_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:37.224456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Write session: try to update token
2025-10-01T14:15:37.224473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:37.233042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:37.233060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.233071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.233118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:37.233128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:37.233279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:37.233420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:37.233554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:37.233693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:37.233887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:37.233918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:37.238360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId: src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:37.241099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:37.241310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.241344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.241382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:37.241489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:37.254099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:37.254117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.254119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:37.254121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:37.254130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.254133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.254136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256813048001436:7062]
2025-10-01T14:15:37.254181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:37.254188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:37.254195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.254195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:37.254197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:37.254199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:37.254345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:37.299486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256815424922773:3353]
2025-10-01T14:15:37.299683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2594, pipe: [1:7556256815424922773:3353]
2025-10-01T14:15:37.401475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:37.409241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.409270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.409438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.409504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.409569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.409636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.409750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.409760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.409828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.409890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.409956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.410024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.410068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.410075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.410140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.410201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.410263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.410321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.410363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.410366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.410482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.410544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.410613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.410673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.410718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.410725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.410791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.410854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.410918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.410982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.411029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.411035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.411103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.411162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.411221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.411282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.411327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.411333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.411395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.411451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.411513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.411575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.411618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.411624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.411686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.411742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.411799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.411861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.411906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.411912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.411973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.412028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.412084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.412141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.412180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.412185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.412245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:37.412299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:37.412355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:37.412411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:37.412452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:37.412457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:37.412518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922773:3353], now have 1 active actors on pipe
2025-10-01T14:15:37.412770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:37.412785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256815424922773:3353]
2025-10-01T14:15:37.412811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:37.412813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:37.412841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2595 reason: error at write: Disconnected sessionId: src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0
2025-10-01T14:15:37.413153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:37.413164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Write session will restart in 0.009560s
2025-10-01T14:15:37.413006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2595 sessionId: src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0 is DEAD
2025-10-01T14:15:37.413191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Write session: Do CDS request
2025-10-01T14:15:37.413197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:37.413378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:37.423865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.423946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:37.423973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2596
2025-10-01T14:15:37.424085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.424116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:37.424121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:37.424124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:37.424252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:37.424496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2596 sessionId:  describe result for acl check
2025-10-01T14:15:37.424538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:37.424545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:37.424546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:37.424551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256815424922922:5523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:37.425037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256815424922922:5523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:37.426565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:37.426778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:37.426788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:37.426799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:37.426843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:37.426879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256813048001654:7044]
2025-10-01T14:15:37.427070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256815424922922:5523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:37.427385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:37.427729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:37.427786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:37.428085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:37.428143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.428150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.428151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.428152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.428153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.428154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.428155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.428157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.428158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.428159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.428160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.428161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.428162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.428163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.428168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.428177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.428181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.428185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.428188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.428192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.428195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.428198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.428201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.428205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.428208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.428211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.428215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.428218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.428225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.428233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.428239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.428249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.428255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.428265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.428268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.428279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.428283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.428292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.428295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.428300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.428307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.428312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.428316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.428320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.428328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.428332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.428340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.428345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.428350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.428359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.428363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.428367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.428375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.428379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.428384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.428392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.428428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:37.431822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256815424922922:5523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:37.431836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256815424922922:5523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:37.431841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256815424922922:5523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:37.431849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:37.432031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:37.432675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:37.432688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:37.432689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:37.432692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:37.432697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2595 [2:7556256813048001654:7044]
2025-10-01T14:15:37.432708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:37.432721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:37.432723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.432725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.432727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.432739Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:37.432746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:37.432750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:37.432803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.432809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.432811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.432814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:37.432817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:37.432875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:37.432879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.432890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.432904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.432923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:37.432945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922958:5523], now have 1 active actors on pipe
2025-10-01T14:15:37.432952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922778:2446], now have 1 active actors on pipe
2025-10-01T14:15:37.432959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.432965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.432968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.432982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:37.432998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:37.433014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:37.433021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:37.433031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2595
2025-10-01T14:15:37.433052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.433060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:37.433070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2595
2025-10-01T14:15:37.433104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:37.433116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:37.433120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:37.433126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:37.433248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.433259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.433287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:37.433298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.433303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.433305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:37.433315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.433328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:37.433347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.433635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.433648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.433669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.433766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2596 partition: 0 MaxSeqNo: 45 sessionId: src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0
2025-10-01T14:15:37.434111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1f44f7-771304b8-dcaf0e10-fff70abc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:37.436801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Write session: try to update token
2025-10-01T14:15:37.436822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:37.450964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId: src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:37.453785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:37.454198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.454222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.454244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:37.454246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.454249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:37.454251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:37.454260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.454265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.454268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256813048001648:7044]
2025-10-01T14:15:37.454305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:37.454317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:37.454320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:37.454326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:37.454333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.454336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:37.454519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:37.512998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256815424922967:3353]
2025-10-01T14:15:37.513300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2595, pipe: [1:7556256815424922967:3353]
2025-10-01T14:15:37.602240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:37.602623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:37.602678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922967:3353], now have 1 active actors on pipe
2025-10-01T14:15:37.602769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:37.602853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256815424922967:3353]
2025-10-01T14:15:37.602881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:37.613926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:37.613939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:37.613963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2596 reason: error at write: Disconnected sessionId: src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0
2025-10-01T14:15:37.614129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2596 sessionId: src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0 is DEAD
2025-10-01T14:15:37.614214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:37.614225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Write session will restart in 0.006063s
2025-10-01T14:15:37.614248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Write session: Do CDS request
2025-10-01T14:15:37.614254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:37.621108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:37.621951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.622039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:37.622055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2597
2025-10-01T14:15:37.622165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.622192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:37.622196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:37.622200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:37.622632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2597 sessionId:  describe result for acl check
2025-10-01T14:15:37.622663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:37.622665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:37.622666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:37.622672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256815424923121:5531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:37.622955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:37.623164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:37.623174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:37.623185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:37.623218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256815424923121:5531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:37.623237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:37.623280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256813048001837:7042]
2025-10-01T14:15:37.623927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:37.624298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:37.624363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:37.624701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:37.624773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.624780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.624781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.624782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.624783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.624785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.624786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.624787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.624789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.624790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.624792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.624793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.624794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.624795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.624803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.624812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.624815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.624818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.624822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.624825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.624828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.624831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.624835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.624838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.624843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.624845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.624848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.624852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.624858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.624866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.624871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.624876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.624880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.624885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.624889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.624894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.624898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.624902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.624907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.624912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.624918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.624922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.624926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.624930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.624935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.624939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.624943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.624948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.624952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.624956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.624960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.624965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.624969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.624979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.624983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.624988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.625020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:37.626343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256815424923121:5531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:37.629175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:37.629910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256815424923121:5531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:37.629926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256815424923121:5531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:37.629929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256815424923121:5531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:37.629937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:37.630127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:37.630142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:37.630145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:37.630148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:37.630154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2596 [2:7556256813048001837:7042]
2025-10-01T14:15:37.630169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:37.630186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:37.630194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.630199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.630202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.630217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:37.630227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:37.630233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:37.630291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.630298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.630300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.630303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:37.630306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:37.630394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:37.630403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.630415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.630426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.630444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:37.630465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424923161:5531], now have 1 active actors on pipe
2025-10-01T14:15:37.630473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424922973:2446], now have 1 active actors on pipe
2025-10-01T14:15:37.630480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.630486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.630488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.630503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:37.630510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2596
2025-10-01T14:15:37.630520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2596
2025-10-01T14:15:37.630514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:37.630520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:37.630525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:37.630529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:37.630531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:37.630535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:37.630581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.630590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.630602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.630612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:37.630618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:37.630642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c75039b-bb36df79-4c973417-10c28b7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:37.630654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.630662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.630664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:37.630672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.630684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:37.630711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.630855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.630868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.630895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.630991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2597 partition: 0 MaxSeqNo: 45 sessionId: src_id|5c75039b-bb36df79-4c973417-10c28b7a_0
2025-10-01T14:15:37.631350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fb07de-7abe03d2-29b4fb33-8cef6832_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5c75039b-bb36df79-4c973417-10c28b7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:37.634160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Write session: try to update token
2025-10-01T14:15:37.634182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:37.648771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId: src_id|5c75039b-bb36df79-4c973417-10c28b7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:37.651139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:37.652151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.652178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.652201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:37.652204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.652207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:37.652209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:37.652218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.652222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.652226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256813048001832:7042]
2025-10-01T14:15:37.652262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:37.652274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:37.652277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:37.652281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:37.652288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.652291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:37.652443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:37.702953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256815424923169:3353]
2025-10-01T14:15:37.703224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2596, pipe: [1:7556256815424923169:3353]
2025-10-01T14:15:37.805051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:37.805375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:37.805432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424923169:3353], now have 1 active actors on pipe
2025-10-01T14:15:37.805513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:37.805653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:37.805703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256815424923169:3353]
2025-10-01T14:15:37.817377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:37.817391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:37.817426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2597 reason: error at write: Disconnected sessionId: src_id|5c75039b-bb36df79-4c973417-10c28b7a_0
2025-10-01T14:15:37.817586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2597 sessionId: src_id|5c75039b-bb36df79-4c973417-10c28b7a_0 is DEAD
2025-10-01T14:15:37.817705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:37.817713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Write session will restart in 0.005098s
2025-10-01T14:15:37.817737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Write session: Do CDS request
2025-10-01T14:15:37.817745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:37.823899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.823985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:37.824000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2598
2025-10-01T14:15:37.824119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:37.824148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:37.824157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:37.824160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:37.824568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2598 sessionId:  describe result for acl check
2025-10-01T14:15:37.824598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:37.824600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:37.824601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:37.824608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256815424923307:5541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:37.825099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256815424923307:5541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:37.826889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:37.827741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256815424923307:5541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:37.829001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:37.829197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:37.829224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:37.829236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:37.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:37.829325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256813048002035:7040]
2025-10-01T14:15:37.829944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:37.830263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:37.830313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:37.830607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256815424923307:5541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:37.830621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256815424923307:5541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:37.830625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256815424923307:5541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:37.830632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:37.830640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:37.830692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.830698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.830699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.830700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.830701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.830703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.830704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.830705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.830706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.830708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.830709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.830711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.830712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.830713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.830718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.830728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.830732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.830736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.830739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.830743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.830747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.830750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.830754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.830758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.830761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.830765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.830768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.830772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.830778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.830786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:37.830791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.830797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:37.830801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.830806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:37.830810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.830815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:37.830821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.830831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:37.830836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.830840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:37.830845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.830854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:37.830858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.830863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:37.830867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.830877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:37.830881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.830886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.830895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.830901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.830905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.830913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.830918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.830922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:37.830930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.830935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:37.830971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:37.834623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:37.835207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:37.835222Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:37.835225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:37.835229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:37.835236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2597 [2:7556256813048002035:7040]
2025-10-01T14:15:37.835252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:37.835269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:37.835276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.835279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.835282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.835298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:37.835306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:37.835313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:37.835373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.835379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.835381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.835385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:37.835387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:37.835457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:37.835466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.835477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:37.835487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:37.835503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:37.835521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424923355:5541], now have 1 active actors on pipe
2025-10-01T14:15:37.835524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424923172:2446], now have 1 active actors on pipe
2025-10-01T14:15:37.835531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.835533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.835535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.835547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:37.835559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:37.835561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:37.835563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:37.835565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:37.835572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:37.835575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:37.835605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.835607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:37.835614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:37.835640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.835646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.835670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:37.835676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:37.835681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:37.835683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:37.835692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:37.835700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:37.835717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.835846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.835855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.835869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:37.836328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c75039b-bb36df79-4c973417-10c28b7a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:37.835599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2597
2025-10-01T14:15:37.835641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2597
2025-10-01T14:15:37.835963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2598 partition: 0 MaxSeqNo: 45 sessionId: src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0
2025-10-01T14:15:37.838942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Write session: try to update token
2025-10-01T14:15:37.838961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:37.857165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId: src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:37.859618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:37.861613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:37.861637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:37.861661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:37.861664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:37.861667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:37.861669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:37.861678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.861684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.861691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256813048002030:7040]
2025-10-01T14:15:37.861749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:37.861760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:37.861763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:37.861889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:37.862428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:37.862444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:37.862449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:37.905716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256815424923365:3353]
2025-10-01T14:15:37.906013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2597, pipe: [1:7556256815424923365:3353]
2025-10-01T14:15:38.007927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:38.008461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:38.008519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256815424923365:3353], now have 1 active actors on pipe
2025-10-01T14:15:38.008611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:38.008712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:38.008714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:38.008788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2598 reason: error at write: Disconnected sessionId: src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0
2025-10-01T14:15:38.008949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2598 sessionId: src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0 is DEAD
2025-10-01T14:15:38.009086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:38.009097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Write session will restart in 0.009340s
2025-10-01T14:15:38.009123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Write session: Do CDS request
2025-10-01T14:15:38.009129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:38.009125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256815424923365:3353]
2025-10-01T14:15:38.009145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:38.019915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.019998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:38.020015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2599
2025-10-01T14:15:38.020170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.020225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:38.020229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:38.020233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:38.020594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2599 sessionId:  describe result for acl check
2025-10-01T14:15:38.020621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:38.020623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:38.020625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:38.020629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256819719890768:5563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:38.021139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256819719890768:5563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:38.023532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256819719890768:5563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:38.025604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:38.028118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:38.028297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256819719890768:5563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:38.028310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256819719890768:5563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:38.028315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256819719890768:5563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:38.028322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:38.028336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:38.028347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:38.028358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:38.028411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:38.028445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256817342969518:7033]
2025-10-01T14:15:38.029003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:38.029324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:38.029367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:38.029640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:38.029692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.029699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.029701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.029702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.029702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.029703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.029704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.029705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.029706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.029707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.029708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.029708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.029709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.029710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.029714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.029722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.029726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.029729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.029732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.029735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.029738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.029741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.029744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.029748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.029750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.029753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.029756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.029759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.029765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.029772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.029777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.029782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.029786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.029790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.029793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.029798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.029802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.029806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.029809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.029813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.029817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.029821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.029825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.029829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.029833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.029837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.029840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.029844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.029848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.029852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.029855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.029860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.029863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.029869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.029872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.029876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.029907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:38.033764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:38.034653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:38.034666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:38.034668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:38.034672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:38.034678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2598 [2:7556256817342969518:7033]
2025-10-01T14:15:38.034692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:38.034707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:38.034710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.034714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.034716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.034733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:38.034738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:38.034744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:38.034800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.034808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.034809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.034812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:38.034815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:38.034882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:38.034889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.034900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.034910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.034925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:38.034944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719890678:2446], now have 1 active actors on pipe
2025-10-01T14:15:38.034952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719890857:5563], now have 1 active actors on pipe
2025-10-01T14:15:38.034959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.034961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.034964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.034977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:38.034989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:38.034993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:38.034995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:38.034996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:38.035011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:38.035014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:38.034996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2598
2025-10-01T14:15:38.034996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2598
2025-10-01T14:15:38.035049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.035061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:38.035066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:38.035083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.035092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.035138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1be3936-db556816-f51b7037-fbf87f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:38.035151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.035159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.035161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:38.035169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.035181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:38.035206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.035462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.035478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.035500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.035767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2599 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1be3936-db556816-f51b7037-fbf87f8_0
2025-10-01T14:15:38.036151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144d85ec-3a9d0da2-4dfcffab-124a8042_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1be3936-db556816-f51b7037-fbf87f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:38.038748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Write session: try to update token
2025-10-01T14:15:38.038767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:38.054313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId: src_id|c1be3936-db556816-f51b7037-fbf87f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:38.056040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:38.056065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.056068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:38.056070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:38.056079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.056085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.056089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256817342969513:7033]
2025-10-01T14:15:38.056136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:38.056140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:38.056148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.056150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:38.056151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:38.056163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:38.056291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:38.056825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:38.109493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256819719890879:3353]
2025-10-01T14:15:38.110232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2598, pipe: [1:7556256819719890879:3353]
2025-10-01T14:15:38.218425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:38.218944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.218963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.219010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719890879:3353], now have 1 active actors on pipe
2025-10-01T14:15:38.219240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256819719890879:3353]
2025-10-01T14:15:38.219244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:38.219248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:38.219276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:38.219307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2599 reason: error at write: Disconnected sessionId: src_id|c1be3936-db556816-f51b7037-fbf87f8_0
2025-10-01T14:15:38.219462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:38.219486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2599 sessionId: src_id|c1be3936-db556816-f51b7037-fbf87f8_0 is DEAD
2025-10-01T14:15:38.219649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:38.219659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Write session will restart in 0.009537s
2025-10-01T14:15:38.219686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Write session: Do CDS request
2025-10-01T14:15:38.219692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:38.230919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.231340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:38.231356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2600
2025-10-01T14:15:38.231498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.231532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:38.231540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:38.231543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:38.231948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2600 sessionId:  describe result for acl check
2025-10-01T14:15:38.231985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:38.231987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:38.231989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:38.231995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256819719891040:5577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:38.232482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256819719891040:5577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:38.233447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:38.234325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256819719891040:5577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:38.235771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:38.235984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:38.235995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:38.236007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:38.236058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:38.236099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256817342969711:7019]
2025-10-01T14:15:38.236685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:38.236973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:38.237013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:38.237078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256819719891040:5577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:38.237096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256819719891040:5577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:38.237099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256819719891040:5577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:38.237107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:38.237300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:38.237354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.237360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.237361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.237362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.237364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.237365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.237366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.237367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.237368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.237369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.237370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.237372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.237373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.237374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.237379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.237388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.237391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.237395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.237398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.237402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.237406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.237409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.237413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.237417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.237421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.237424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.237427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.237431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.237437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.237444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.237450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.237455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.237459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.237464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.237468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.237478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.237483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.237492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.237496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.237501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.237507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.237516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.237521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.237530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.237534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.237539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.237547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.237552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.237556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.237565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.237569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.237573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.237581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.237585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.237590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.237598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.237634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:38.241247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:38.241865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:38.241878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:38.241880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:38.241883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:38.241890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2599 [2:7556256817342969711:7019]
2025-10-01T14:15:38.241906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:38.241927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:38.241934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.241938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.241940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.241955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:38.241964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:38.241970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:38.242026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.242034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.242036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.242039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:38.242042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:38.242106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:38.242114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.242124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.242134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.242147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:38.242169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891079:5577], now have 1 active actors on pipe
2025-10-01T14:15:38.242176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719890894:2446], now have 1 active actors on pipe
2025-10-01T14:15:38.242184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.242186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.242189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.242201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:38.242216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:38.242221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:38.242224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:38.242226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:38.242233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:38.242235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:38.242265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.242273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:38.242275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:38.242289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.242299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.242347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:38.242358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.242363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.242382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:38.242391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.242399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:38.242417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.242231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2599
2025-10-01T14:15:38.242235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2599
2025-10-01T14:15:38.242615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.242626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.242646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.242765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2600 partition: 0 MaxSeqNo: 45 sessionId: src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0
2025-10-01T14:15:38.243133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be3936-db556816-f51b7037-fbf87f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:38.245699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Write session: try to update token
2025-10-01T14:15:38.245716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:38.260476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId: src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:38.262871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:38.263234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.263260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.263283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:38.263286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.263288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:38.263290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:38.263299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.263304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.263308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256817342969706:7019]
2025-10-01T14:15:38.263349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:38.263370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:38.263372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:38.263377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.263377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:38.263379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:38.263502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:38.319401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256819719891088:3353]
2025-10-01T14:15:38.319713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2599, pipe: [1:7556256819719891088:3353]
2025-10-01T14:15:38.418267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:38.418788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:38.418861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891088:3353], now have 1 active actors on pipe
2025-10-01T14:15:38.419436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:38.419524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:38.419527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:38.419602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2600 reason: error at write: Disconnected sessionId: src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0
2025-10-01T14:15:38.419739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2600 sessionId: src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0 is DEAD
2025-10-01T14:15:38.419835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256819719891088:3353]
2025-10-01T14:15:38.419854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:38.420265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:38.420274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Write session will restart in 0.007473s
2025-10-01T14:15:38.420302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Write session: Do CDS request
2025-10-01T14:15:38.420311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:38.428925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.429322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:38.429339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2601
2025-10-01T14:15:38.429466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.429504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:38.429513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:38.429516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:38.429946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2601 sessionId:  describe result for acl check
2025-10-01T14:15:38.429986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:38.429992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:38.429995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:38.430001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256819719891115:5583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:38.430528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256819719891115:5583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:38.432978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256819719891115:5583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:38.435911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256819719891115:5583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:38.435928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256819719891115:5583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:38.435931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256819719891115:5583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:38.435939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:38.437122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:38.439253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:38.439491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:38.439501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:38.439513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:38.439566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:38.439613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256817342969930:6999]
2025-10-01T14:15:38.440239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:38.440625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:38.440677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:38.440988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:38.441049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.441055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.441056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.441057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.441058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.441059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.441061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.441062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.441063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.441064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.441065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.441066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.441067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.441068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.441073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.441082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.441086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.441089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.441092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.441095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.441098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.441101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.441104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.441107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.441110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.441113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.441116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.441120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.441136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.441143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.441150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.441155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.441158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.441163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.441167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.441171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.441175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.441179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.441183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.441187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.441191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.441195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.441199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.441204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.441209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.441213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.441216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.441220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.441224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.441228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.441231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.441237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.441245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.441249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.441253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.441261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.441296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:38.445088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:38.445966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:38.445982Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:38.445984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:38.445987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:38.445993Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2600 [2:7556256817342969930:6999]
2025-10-01T14:15:38.446011Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:38.446027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:38.446036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.446040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.446042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.446058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:38.446067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:38.446074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:38.446125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.446132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.446133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.446136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:38.446138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:38.446350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2600
2025-10-01T14:15:38.446364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2600
2025-10-01T14:15:38.446201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:38.446211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.446221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.446230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.446242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:38.446260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891273:5583], now have 1 active actors on pipe
2025-10-01T14:15:38.446263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891091:2446], now have 1 active actors on pipe
2025-10-01T14:15:38.446271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.446273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.446274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.446290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:38.446302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:38.446304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:38.446313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:38.446315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:38.446316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:38.446318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:38.446349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.446357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:38.446384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:38.446414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.446418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.446442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:38.446448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.446452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.446454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:38.446464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.446472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:38.446485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.446644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.446651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.446749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2601 partition: 0 MaxSeqNo: 45 sessionId: src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0
2025-10-01T14:15:38.446674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.447112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bb6f4f-afd88519-3ccc8ba4-48c4e78e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:38.449676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Write session: try to update token
2025-10-01T14:15:38.449695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:38.456984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:38.457003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.457013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.457050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:38.457057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:38.457222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:38.457358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.457489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.457645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.457820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:38.457857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:38.463822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId: src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:38.465971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:38.466208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.466227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.466265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:38.466350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:38.476121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:38.476141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.476144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:38.476146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:38.476157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.476161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.476163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256817342969925:6999]
2025-10-01T14:15:38.476204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:38.476212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:38.476215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.476217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:38.476217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:38.476220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:38.476334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:38.519569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256819719891286:3353]
2025-10-01T14:15:38.519805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2600, pipe: [1:7556256819719891286:3353]
2025-10-01T14:15:38.638806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:38.647330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.647356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.647525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.647582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.647646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.647709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.647751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.647756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.647828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.647885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.647944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.648010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.648049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.648056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.648122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.648181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.648242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.648301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.648347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.648350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.648416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.648475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.648550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.648613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.648652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.648655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.648717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.648766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.648817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.648873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.648912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.648915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.648978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.649035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.649090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.649147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.649204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.649207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.649266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.649316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.649377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.649433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.649471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.649474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.649535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.649592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.649646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.649699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.649741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.649743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.649802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.649853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.649909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.649965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.650002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.650005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.650066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.650127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.650188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.650251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.650296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.650299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.650634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891286:3353], now have 1 active actors on pipe
2025-10-01T14:15:38.652220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256819719891286:3353]
2025-10-01T14:15:38.652250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:38.652286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0
2025-10-01T14:15:38.652465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2601 sessionId: src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0 is DEAD
2025-10-01T14:15:38.652604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:38.652626Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:15:38.652703Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 26 consumer shared/user session shared/user_1_26_15928283803113236713_v1 is DEAD
2025-10-01T14:15:38.653101Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:15:38.653107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:38.653119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Write session will restart in 0.009515s
2025-10-01T14:15:38.653144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Write session: Do CDS request
2025-10-01T14:15:38.653149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:38.653253Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:15:38.653257Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:15:38.653266Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009503s
2025-10-01T14:15:38.653198Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256738115496949:3361] disconnected; active server actors: 1
2025-10-01T14:15:38.653210Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256738115496949:3361] client user disconnected session shared/user_1_26_15928283803113236713_v1
2025-10-01T14:15:38.651585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:38.666854Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:15:38.666872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.667193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:38.667208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2602
2025-10-01T14:15:38.667251Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:15:38.667257Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 27
2025-10-01T14:15:38.668443Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_27_4210109461526957791_v1
2025-10-01T14:15:38.667433Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 27 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:15:38.667483Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:15:38.667557Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 auth for : user
2025-10-01T14:15:38.667924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.667948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:38.667953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:38.667956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:38.668015Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 Handle describe topics response
2025-10-01T14:15:38.668034Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 auth is DEAD
2025-10-01T14:15:38.668058Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:15:38.668306Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:15:38.668394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2602 sessionId:  describe result for acl check
2025-10-01T14:15:38.668418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:38.668419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:38.668420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:38.668425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256819719891391:5596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:38.668889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256819719891391:5596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:38.669008Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256819719891390:5595] connected; active server actors: 1
2025-10-01T14:15:38.669018Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256819719891390:5595] session shared/user_1_27_4210109461526957791_v1
2025-10-01T14:15:38.669028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:15:38.669038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:15:38.669044Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_27_4210109461526957791_v1" (Sender=[1:7556256819719891370:5595], Pipe=[1:7556256819719891390:5595], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:15:38.669048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:15:38.669058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:15:38.669066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_27_4210109461526957791_v1" (Sender=[1:7556256819719891370:5595], Pipe=[1:7556256819719891390:5595], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:15:38.669076Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_27_4210109461526957791_v1" sender [1:7556256819719891370:5595] lock partition 0 for ReadingSession "shared/user_1_27_4210109461526957791_v1" (Sender=[1:7556256819719891370:5595], Pipe=[1:7556256819719891390:5595], Partitions=[], ActiveFamilyCount=1) generation 1 step 27
2025-10-01T14:15:38.669083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:15:38.669087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-01T14:15:38.669276Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 27 Session: "shared/user_1_27_4210109461526957791_v1" ClientId: "user" PipeClient { RawX1: 7556256819719891390 RawX2: 4503603922343387 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:15:38.669301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:15:38.672954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256819719891391:5596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:38.678033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:38.678016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256819719891391:5596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:38.678031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256819719891391:5596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:38.678034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256819719891391:5596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:38.678052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:38.680952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:38.681206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:38.681217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:38.681229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:38.681280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:38.681331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256817342970133:6997]
2025-10-01T14:15:38.681957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:38.682320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:38.682386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:38.682695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:38.682742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.682744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.682745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.682746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.682748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.682749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.682750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.682751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.682752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.682753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.682755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.682756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.682757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.682758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.682763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.682773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.682777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.682781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.682785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.682789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.682793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.682797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.682801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.682805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.682809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.682812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.682816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.682820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.682827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.682835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.682841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.682846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.682851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.682856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.682860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.682865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.682870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.682875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.682880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.682885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.682890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.682896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.682900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.682906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.682911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.682916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.682921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.682927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.682931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.682936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.682940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.682946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.682950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.682956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.682961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.682966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.683008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:38.687651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:38.688321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:38.688335Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:38.688338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:38.688342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:38.688349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2601 [2:7556256817342970133:6997]
2025-10-01T14:15:38.688366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:38.688384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:38.688387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.688391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.688394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.688410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:38.688420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:38.688427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:38.688490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.688498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.688500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.688503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:38.688506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:38.688584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:38.688592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.688605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.688621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.688642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:38.688665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891297:2446], now have 1 active actors on pipe
2025-10-01T14:15:38.688672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891399:5610], now have 1 active actors on pipe
2025-10-01T14:15:38.688675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891486:5596], now have 1 active actors on pipe
2025-10-01T14:15:38.688682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.688685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.688687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.688701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:38.688719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:38.688739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:38.688746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:38.688786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.688793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:38.688752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2601
2025-10-01T14:15:38.688757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2601, pipe: [1:7556256819719891399:5610]
2025-10-01T14:15:38.688783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2601
2025-10-01T14:15:38.688942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:38.688950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:38.688952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:38.688957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:38.689200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.689213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.689227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_27_4210109461526957791_v1 on pipe: [1:7556256819719891399:5610]
2025-10-01T14:15:38.689255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.689262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.689276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.689282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.689285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:38.689305Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_27_4210109461526957791_v1
2025-10-01T14:15:38.689308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.689341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:38.689347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:15:38.689352Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:15:38.689406Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_27_4210109461526957791_v1:1 with generation 2601
2025-10-01T14:15:38.695535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:15:38.695573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:15:38.695582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.695589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.695592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:38.695604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.695618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:38.695631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:15:38.695657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:15:38.695678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.695868Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328138688 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:15:38.695889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:15:38.695921Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 sending to client partition status
2025-10-01T14:15:38.696273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.696292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.696318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.696418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2602 partition: 0 MaxSeqNo: 45 sessionId: src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0
2025-10-01T14:15:38.696743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0d1930-762d8a6f-cde3ff02-39c512aa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:38.699484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Write session: try to update token
2025-10-01T14:15:38.699504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:38.701046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:38.701066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.701075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.701119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:38.701286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:38.701428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.701573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.701724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.701911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:38.701951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:38.702198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:38.715615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId: src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:38.718347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:38.718928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.718954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.718993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:38.719136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:38.723054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:38.723075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.723078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:38.723080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:38.723091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.723095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.723099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256817342970127:6997]
2025-10-01T14:15:38.723150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:38.723158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.723160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:38.723296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:38.734450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:38.734474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:38.734477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:38.929976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:38.938758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.938792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.938969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.939040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.939098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.939158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.939200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.939208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.939276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.939331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.939388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.939448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.939488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.939492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.939568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.939624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.939688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.939749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.939796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.939799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.939872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.939931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.940004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.940074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.940120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.940128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.940200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.940266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.940336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.940404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.940448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.940455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.940535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.940604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.940670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.940737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.942457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:38.940788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.940791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.940865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.942459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256819719891399:5610]
2025-10-01T14:15:38.940921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.940990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.942488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:38.941054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.941096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.942492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:38.941099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.941175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.942523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2602 reason: error at write: Disconnected sessionId: src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0
2025-10-01T14:15:38.941237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.941298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.941360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.941405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.941407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.941481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.941540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.941600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.941660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.941702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.941704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.941770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:38.941824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:38.941882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:38.941940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:38.941981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:38.941984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:38.942742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2602 sessionId: src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0 is DEAD
2025-10-01T14:15:38.942860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:38.942872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Write session will restart in 0.005531s
2025-10-01T14:15:38.942903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Write session: Do CDS request
2025-10-01T14:15:38.942909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:38.943494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_27_4210109461526957791_v1
2025-10-01T14:15:38.943513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:38.943840Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_27_4210109461526957791_v1
2025-10-01T14:15:38.950216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.950326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:38.950341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2603
2025-10-01T14:15:38.950465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:38.950496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:38.950500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:38.950504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:38.950852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2603 sessionId:  describe result for acl check
2025-10-01T14:15:38.950881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:38.950883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:38.950884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:38.950888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256819719891519:5614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:38.951339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256819719891519:5614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:38.954194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256819719891519:5614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:38.959251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256819719891519:5614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:38.959267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256819719891519:5614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:38.959271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256819719891519:5614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:38.959279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:38.970323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:38.974190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:38.974443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:38.974448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:38.974459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:38.974512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:38.974546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256817342970328:6989]
2025-10-01T14:15:38.975114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:38.975543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:38.975584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:38.975884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:38.975934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.975935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.975936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.975938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.975939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.975940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.975941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.975942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.975943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.975944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.975945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.975946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.975948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.975949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.975953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.975962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.975965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.975969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.975972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.975975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.975978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.975982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.975985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.975990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.975992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.975996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.975999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.976002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.976010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.976017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:38.976022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.976027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:38.976031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.976035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:38.976038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.976043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:38.976047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.976051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:38.976055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.976060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:38.976064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.976069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:38.976073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.976079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:38.976082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.976087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:38.976090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.976095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.976099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.976103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.976107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.976112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.976116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.976121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:38.976124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.976128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:38.976161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:38.980920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:38.981557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:38.981576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:38.981579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:38.981583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:38.981590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2602 [2:7556256817342970328:6989]
2025-10-01T14:15:38.981609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:38.981627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:38.981630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.981633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.981636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.981655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:38.981660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:38.981667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:38.981730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.981740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.981742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.981746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:38.981749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:38.981821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:38.981828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:38.981840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:38.981854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:38.981877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:38.981897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891588:5614], now have 1 active actors on pipe
2025-10-01T14:15:38.981901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256819719891503:2446], now have 1 active actors on pipe
2025-10-01T14:15:38.981909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:38.981911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:38.981913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:38.982228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2602
2025-10-01T14:15:38.982280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2602
2025-10-01T14:15:38.981927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:38.981941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:38.981944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:38.981947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:38.981948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:38.981963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:38.981966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:38.982005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:38.982013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:38.982019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:38.982413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.982430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.982459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:38.982471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:38.982480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:38.982482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:38.982492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:38.982507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:38.982530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.982689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:38.982697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:38.982711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:38.982782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2603 partition: 0 MaxSeqNo: 45 sessionId: src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0
2025-10-01T14:15:38.983211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a231a50f-e24dcf6c-92908b8c-2bb61ae3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:38.985960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Write session: try to update token
2025-10-01T14:15:38.985979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:38.993515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:38.993540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:38.993551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:38.993596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:38.993602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:38.993781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:38.993939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.994091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.994233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:38.994458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:38.994504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:39.003695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId: src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:39.006364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:39.006691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.006713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.006752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:39.006900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:39.018180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:39.018207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.018210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:39.018212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:39.018225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:39.018230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:39.018235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256817342970323:6989]
2025-10-01T14:15:39.018281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:39.018285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:39.018287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:39.018291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:39.018293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.018296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:39.018456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:39.046429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256824014859002:5610]
2025-10-01T14:15:39.046857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2602, pipe: [1:7556256824014859002:5610]
2025-10-01T14:15:39.189802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:39.190246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859002:5610], now have 1 active actors on pipe
2025-10-01T14:15:39.198631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.198664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.198839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.198903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.198965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.199026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.199067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.199073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.199140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.199202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.199259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.199323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.199367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.199370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.199451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.199516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.199580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.199646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.199690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.199694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.199768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.199827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.199887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.199947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.199991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.199994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.200063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.200118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.200396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.200468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.200625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.200633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.200702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.200759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.200825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.200883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.200925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.200928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.200994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.201048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.201106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.201172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.201213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.201216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.201288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.201346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.201409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.201475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.201516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.201521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.201591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.202715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256824014859002:5610]
2025-10-01T14:15:39.202718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:39.202752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:39.202755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:39.202783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2603 reason: error at write: Disconnected sessionId: src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0
2025-10-01T14:15:39.203212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:39.203224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Write session will restart in 0.005130s
2025-10-01T14:15:39.203201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2603 sessionId: src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0 is DEAD
2025-10-01T14:15:39.203252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Write session: Do CDS request
2025-10-01T14:15:39.203258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:39.201883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.201958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.202019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.202061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.202064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.202132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.202190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.202250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.202317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.202360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.202363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.203650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:39.209944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.210324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:39.210337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2604
2025-10-01T14:15:39.210485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.210513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:39.210521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:39.210524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:39.210891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2604 sessionId:  describe result for acl check
2025-10-01T14:15:39.210921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:39.210923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:39.210929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:39.210934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256824014859050:5647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:39.211390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256824014859050:5647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:39.214183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256824014859050:5647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:39.218598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256824014859050:5647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:39.218612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256824014859050:5647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:39.218616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256824014859050:5647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:39.218623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:39.223994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:39.226014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:39.226238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:39.226251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:39.226263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:39.226307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:39.226345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256821637937821:6982]
2025-10-01T14:15:39.226985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:39.227384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:39.227430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:39.227739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:39.227788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.227794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.227795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.227796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.227797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.227798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.227799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.227801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.227802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.227803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.227805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.227806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.227807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.227808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.227814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.227824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.227828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.227832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.227836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.227840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.227844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.227848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.227851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.227855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.227858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.227862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.227866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.227870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.227876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.227888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.227899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.227904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.227913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.227919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.227927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.227932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.227942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.227948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.227953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.227962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.227967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.227976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.227980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.227989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.227994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.228002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.228007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.228016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.228021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.228029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.228034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.228043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.228048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.228057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.228062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.228071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.228111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:39.232264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:39.233561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2603
2025-10-01T14:15:39.233594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2603
2025-10-01T14:15:39.232952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:39.232970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:39.232973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:39.232977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:39.232986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2603 [2:7556256821637937821:6982]
2025-10-01T14:15:39.233003Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:39.233023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:39.233027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.233030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.233033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.233051Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:39.233058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:39.233066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:39.233129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.233132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.233134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.233138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:39.233141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:39.233217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:39.233220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.233233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.233243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.233259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:39.233277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859119:5647], now have 1 active actors on pipe
2025-10-01T14:15:39.233280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859037:2446], now have 1 active actors on pipe
2025-10-01T14:15:39.233288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.233290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.233293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.234464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2604 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0
2025-10-01T14:15:39.233305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:39.233319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:39.233330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:39.233331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:39.233333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:39.233334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:39.233335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:39.233369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.233376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:39.233381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:39.233856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.233864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.233897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:39.233905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.233910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.233913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:39.233924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.233936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:39.233954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.234320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.234325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.234345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.238503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6785777b-ff88f3ad-e203078c-18ce5d67_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:39.241211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Write session: try to update token
2025-10-01T14:15:39.241231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:39.256897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:39.256917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.256919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:39.256921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:39.256930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.256934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.256936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256821637937816:6982]
2025-10-01T14:15:39.256980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:39.256986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.256985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:39.256989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:39.256991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:39.256995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:39.257118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:39.259780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId: src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:39.262264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:39.303235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256824014859234:5610]
2025-10-01T14:15:39.303725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2603, pipe: [1:7556256824014859234:5610]
2025-10-01T14:15:39.413147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:39.413456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.413470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.413513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859234:5610], now have 1 active actors on pipe
2025-10-01T14:15:39.413723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:39.413737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:39.413797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2604 reason: error at write: Disconnected sessionId: src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0
2025-10-01T14:15:39.413996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2604 sessionId: src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0 is DEAD
2025-10-01T14:15:39.413706Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:39.414128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:39.414137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Write session will restart in 0.008011s
2025-10-01T14:15:39.414144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:39.414155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256824014859234:5610]
2025-10-01T14:15:39.414164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Write session: Do CDS request
2025-10-01T14:15:39.414198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:39.424718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.425412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:39.425427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2605
2025-10-01T14:15:39.425567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.425599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:39.425610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:39.425613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:39.426014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2605 sessionId:  describe result for acl check
2025-10-01T14:15:39.426058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:39.426064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:39.426066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:39.426071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256824014859283:5645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:39.426531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256824014859283:5645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:39.436190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256824014859283:5645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:39.441535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256824014859283:5645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:39.441552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256824014859283:5645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:39.441555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256824014859283:5645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:39.441564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:39.443038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:39.447439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:39.447756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:39.447766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:39.447777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:39.447831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:39.447874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256821637938027:6980]
2025-10-01T14:15:39.448409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:39.448749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:39.448792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:39.449040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:39.449090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.449096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.449098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.449099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.449100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.449101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.449103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.449104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.449105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.449107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.449108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.449109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.449110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.449112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.449116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.449126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.449130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.449134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.449138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.449142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.449146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.449150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.449153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.449158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.449162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.449165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.449169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.449173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.449178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.449186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.449192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.449198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.449202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.449208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.449216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.449221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.449231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.449236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.449243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.449248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.449252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.449256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.449264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.449269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.449273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.449283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.449288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.449293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.449298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.449303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.449307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.449312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.449323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.449328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.449336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.449341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.449383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:39.453733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:39.454531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:39.454544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:39.454546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:39.454549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:39.454557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2604 [2:7556256821637938027:6980]
2025-10-01T14:15:39.454576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:39.454598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:39.454605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.454609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.454615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.454633Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:39.454642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:39.454650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:39.454714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.454720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.454722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.454725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:39.454728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:39.454792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:39.454799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.454809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.454818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.454832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:39.454851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.454853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.454855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.454863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:39.454872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:39.454875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:39.454877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859419:5645], now have 1 active actors on pipe
2025-10-01T14:15:39.454878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:39.454885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:39.454900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:39.454904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:39.454909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859236:2446], now have 1 active actors on pipe
2025-10-01T14:15:39.454945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.454957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:39.454949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2604
2025-10-01T14:15:39.455012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2604
2025-10-01T14:15:39.454968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:39.455146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.455151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.455175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:39.455182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.455186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.455188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:39.455196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.455204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:39.455226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.455377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.455390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.455410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.455509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2605 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0
2025-10-01T14:15:39.455873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3177ba-db146cc4-5ab199d4-8ba91f18_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:39.458646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Write session: try to update token
2025-10-01T14:15:39.458664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:39.469352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:39.469367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.469376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.469424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:39.469427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:39.469581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:39.469702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:39.469818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:39.469941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:39.470108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:39.470137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:39.476066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId: src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:39.478619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:39.478835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.478858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.478905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:39.479008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:39.488490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:39.488510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.488512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:39.488514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:39.488541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.488545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.488548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256821637938022:6980]
2025-10-01T14:15:39.488595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:39.488602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.488605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:39.488616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:39.488630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:39.488634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:39.488727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:39.514408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256824014859434:5610]
2025-10-01T14:15:39.514635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2604, pipe: [1:7556256824014859434:5610]
2025-10-01T14:15:39.641149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:39.650513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.650544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.650736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.650797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.650863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.650927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.650978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.650983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.651051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.651112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.651168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.651229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.651290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.651293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.651359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.651414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.651474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.651533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.651575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.651578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.651642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.651700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.651754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.651812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.651849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.651851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.651912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.651968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.652027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.652088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.652127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.652130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.652188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.652244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.652302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.652360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.652404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.652406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.652472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.652540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.652605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.652666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.652709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.652711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.652778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.652834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.652891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.652948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.652989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.652992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.653060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.653114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.653173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.653228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.653267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.653269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.653330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.653385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.653444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.653501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.653542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.653545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.653631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859434:5610], now have 1 active actors on pipe
2025-10-01T14:15:39.653961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:39.654638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:39.654690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256824014859434:5610]
2025-10-01T14:15:39.654716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:39.654758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2605 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0
2025-10-01T14:15:39.654943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2605 sessionId: src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0 is DEAD
2025-10-01T14:15:39.658573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:39.658587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Write session will restart in 0.007506s
2025-10-01T14:15:39.658612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Write session: Do CDS request
2025-10-01T14:15:39.658618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:39.670786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.670909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:39.670929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2606
2025-10-01T14:15:39.671094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.671131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:39.671137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:39.671141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:39.671584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2606 sessionId:  describe result for acl check
2025-10-01T14:15:39.671614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:39.671615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:39.671617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:39.671623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256824014859491:5653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:39.672207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256824014859491:5653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:39.677378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:39.677481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256824014859491:5653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:39.680064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:39.680290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:39.680301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:39.680312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:39.680371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:39.680408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256821637938248:6959]
2025-10-01T14:15:39.680483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256824014859491:5653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:39.680503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256824014859491:5653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:39.680507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256824014859491:5653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:39.680516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:39.681013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:39.681383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:39.681427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:39.681720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:39.681780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.681789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.681790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.681792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.681793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.681794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.681795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.681796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.681797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.681798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.681799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.681800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.681801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.681803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.681807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.681817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.681821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.681825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.681829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.681833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.681836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.681840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.681843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.681847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.681851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.681855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.681858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.681862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.681869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.681876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.681882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.681887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.681891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.681896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.681901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.681906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.681911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.681916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.681919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.681924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.681929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.681933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.681937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.681942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.681946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.681952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.681960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.681964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.681970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.681979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.681984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.681993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.681997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.682006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.682010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.682014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.682051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:39.689902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:39.691337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:39.691354Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:39.691357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:39.691362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:39.691369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2605 [2:7556256821637938248:6959]
2025-10-01T14:15:39.691386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:39.691400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:39.691402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.691404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.691406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.691419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:39.691423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:39.691428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:39.691483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.691489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.691490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.691492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:39.691494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:39.691549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:39.691553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.691562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.691567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.691576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:39.691587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.691589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.691590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.691596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:39.691605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:39.691614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:39.691615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:39.691623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859634:5653], now have 1 active actors on pipe
2025-10-01T14:15:39.691622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:39.691626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859445:2446], now have 1 active actors on pipe
2025-10-01T14:15:39.691627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:39.691629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:39.691653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.691657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:39.691679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:39.691949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2605
2025-10-01T14:15:39.691950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2605
2025-10-01T14:15:39.692163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.692170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.692191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|689bc16f-adf8325a-801751e2-620a24f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:39.692199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.692202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.692204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:39.692212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.692222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:39.692234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.692441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.692447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.692458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.692562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2606 partition: 0 MaxSeqNo: 45 sessionId: src_id|689bc16f-adf8325a-801751e2-620a24f8_0
2025-10-01T14:15:39.692885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc3a4c1c-2a83d3b-b3de7e31-3260cceb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|689bc16f-adf8325a-801751e2-620a24f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:39.696008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Write session: try to update token
2025-10-01T14:15:39.696024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:39.705594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:39.705620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.705629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.705669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:39.705675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:39.705851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:39.705989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:39.706135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:39.706278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:39.706493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:39.706531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:39.713808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId: src_id|689bc16f-adf8325a-801751e2-620a24f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:39.716950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:39.717210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.717236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.717274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:39.717359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:39.726424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:39.726443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.726446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:39.726448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:39.726459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.726464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.726468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256821637938243:6959]
2025-10-01T14:15:39.726516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:39.726523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.726526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:39.726532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:39.726571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:39.726576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:39.726663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:39.754573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256824014859646:5610]
2025-10-01T14:15:39.755048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2605, pipe: [1:7556256824014859646:5610]
2025-10-01T14:15:39.881345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:39.889782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.889813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.889992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.890057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.890127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.890187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.890231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.890239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.890306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.890355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.890475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.890541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.890590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.890598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.890668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.893456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256824014859646:5610]
2025-10-01T14:15:39.893491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:39.893494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:39.893524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2606 reason: error at write: Disconnected sessionId: src_id|689bc16f-adf8325a-801751e2-620a24f8_0
2025-10-01T14:15:39.893840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:39.893916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2606 sessionId: src_id|689bc16f-adf8325a-801751e2-620a24f8_0 is DEAD
2025-10-01T14:15:39.893993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:39.894010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Write session will restart in 0.006444s
2025-10-01T14:15:39.894129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Write session: Do CDS request
2025-10-01T14:15:39.894143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:39.890728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.890801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.890869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.890911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.890914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.890985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.891042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.891100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.891171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.891215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.891218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.891291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.891346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.891404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.891465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.891508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.891511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.891581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.891637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.891701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.891768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.891813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.891816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.891885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.891946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.892009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.892072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.892125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.892127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.892201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.892269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.892331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.892393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.892437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.892440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.892515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.892594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.892654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.892715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.892758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.892761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.892830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:39.892887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:39.892950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:39.893009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:39.893051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:39.893054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:39.893127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859646:5610], now have 1 active actors on pipe
2025-10-01T14:15:39.894723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:39.901888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.905566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:39.905583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2607
2025-10-01T14:15:39.906525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:39.906574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:39.906585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:39.906590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:39.907064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2607 sessionId:  describe result for acl check
2025-10-01T14:15:39.907103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:39.907104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:39.907106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:39.907111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256824014859743:5664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:39.907640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256824014859743:5664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:39.909895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256824014859743:5664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:39.914990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256824014859743:5664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:39.915003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256824014859743:5664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:39.915015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256824014859743:5664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:39.915004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:39.915023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:39.917501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:39.917721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:39.917729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:39.917740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:39.917796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:39.917836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256821637938444:6937]
2025-10-01T14:15:39.918454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:39.918820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:39.918875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:39.919158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:39.919233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.919242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.919243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.919244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.919245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.919246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.919247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.919248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.919249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.919250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.919251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.919252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.919253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.919254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.919269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.919279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.919283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.919287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.919291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.919295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.919299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.919303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.919307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.919311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.919315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.919319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.919322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.919326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.919333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.919341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:39.919347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.919353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:39.919357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.919363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:39.919367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.919372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:39.919376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.919381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:39.919385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.919390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:39.919395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.919400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:39.919409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.919414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:39.919418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.919422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:39.919430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.919435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.919440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.919445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.919449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.919454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.919457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.919462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:39.919467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.919472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:39.919510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:39.923711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:39.924302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:39.924320Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:39.924322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:39.924326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:39.924332Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2606 [2:7556256821637938444:6937]
2025-10-01T14:15:39.924348Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:39.924364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:39.924371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.924375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.924377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.924393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:39.924403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:39.924409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:39.924462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.924469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.924471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.924474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:39.924477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:39.924553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:39.924561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.924573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:39.924585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:39.924602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:39.924620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859838:5664], now have 1 active actors on pipe
2025-10-01T14:15:39.924623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859649:2446], now have 1 active actors on pipe
2025-10-01T14:15:39.924631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.924633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.924635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.924647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:39.924659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:39.924674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:39.924677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:39.924680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:39.924681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:39.924684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:39.924681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2606
2025-10-01T14:15:39.924708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.924694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2606
2025-10-01T14:15:39.924715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:39.924717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:39.924745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.924754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.924782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:39.924793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:39.924797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:39.924803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:39.924812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:39.924820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:39.924836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.924982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:39.924989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:39.925000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:39.925108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2607 partition: 0 MaxSeqNo: 45 sessionId: src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0
2025-10-01T14:15:39.925460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689bc16f-adf8325a-801751e2-620a24f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:39.928497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Write session: try to update token
2025-10-01T14:15:39.928517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:39.946268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:39.946300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:39.946303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:39.946305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:39.946315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.946322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.946327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256821637938438:6937]
2025-10-01T14:15:39.946404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:39.946418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:39.946421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:39.946578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:39.944943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId: src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:39.948224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:39.948468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:39.948490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:39.948496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:39.993642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256824014859850:5610]
2025-10-01T14:15:39.993915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2606, pipe: [1:7556256824014859850:5610]
2025-10-01T14:15:40.101672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:40.102103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.102125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.102172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256824014859850:5610], now have 1 active actors on pipe
2025-10-01T14:15:40.102567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:40.106940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:40.107031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2607 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0
2025-10-01T14:15:40.107226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2607 sessionId: src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0 is DEAD
2025-10-01T14:15:40.107423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256824014859850:5610]
2025-10-01T14:15:40.107449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:40.107445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:40.107466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Write session will restart in 0.008100s
2025-10-01T14:15:40.107496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Write session: Do CDS request
2025-10-01T14:15:40.107501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:40.116956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.118057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:40.118077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2608
2025-10-01T14:15:40.118227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.118270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:40.118280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:40.118284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:40.118724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2608 sessionId:  describe result for acl check
2025-10-01T14:15:40.118763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:40.118769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:40.118771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:40.118775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256828309827201:5682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:40.119266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256828309827201:5682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:40.124025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256828309827201:5682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:40.129677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:40.129508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256828309827201:5682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:40.129526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256828309827201:5682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:40.129534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256828309827201:5682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:40.129542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:40.132413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:40.132653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:40.132666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:40.132676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:40.132728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:40.132767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256825932905934:6922]
2025-10-01T14:15:40.133329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:40.133695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:40.133738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:40.134020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:40.134073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.134079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.134080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.134081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.134082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.134083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.134084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.134085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.134086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.134087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.134088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.134089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.134090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.134091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.134096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.134104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.134111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.134114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.134117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.134120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.134123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.134126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.134130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.134133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.134136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.134139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.134142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.134148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.134155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.134160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.134164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.134168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.134172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.134175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.134180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.134184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.134188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.134192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.134197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.134201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.134207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.134211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.134216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.134219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.134223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.134227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.134231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.134235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.134239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.134242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.134247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.134250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.134255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.134259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.134263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.134295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:40.138097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:40.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:40.138755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:40.138757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:40.138760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:40.138766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2607 [2:7556256825932905934:6922]
2025-10-01T14:15:40.138779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:40.138795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:40.138798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.138801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.138803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.138818Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:40.138823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:40.138834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:40.138886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.138893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.138895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.138898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:40.138900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:40.138965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:40.138976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.138986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.138995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.139007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:40.139025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827364:5682], now have 1 active actors on pipe
2025-10-01T14:15:40.139028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827157:2446], now have 1 active actors on pipe
2025-10-01T14:15:40.139035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.139038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.139040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.139053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:40.139066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:40.139077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:40.139080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:40.139104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.139106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:40.139145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:40.139148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:40.139150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:40.139156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:40.139270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2607
2025-10-01T14:15:40.139297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2607
2025-10-01T14:15:40.139405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.139415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.139442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:40.139453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.139457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.139459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:40.139468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.139480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:40.139495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.139768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.139781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.139799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.139935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2608 partition: 0 MaxSeqNo: 45 sessionId: src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0
2025-10-01T14:15:40.140449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87eb8986-26b2ee9a-8b8808c3-94a5ec5d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:40.143646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Write session: try to update token
2025-10-01T14:15:40.143667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:40.149908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:40.149926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.149933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.149972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:40.150085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:40.150143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:40.150268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.150413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.150542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.150741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:40.150781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:40.158789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId: src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:40.161515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:40.161856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:40.161720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.161740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.161770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:40.168610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:40.168630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.168632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:40.168634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:40.168645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.168649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.168653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256825932905928:6922]
2025-10-01T14:15:40.168696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:40.168702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:40.168703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:40.168708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:40.168708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.168711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:40.168844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:40.207654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256828309827386:5610]
2025-10-01T14:15:40.207898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2607, pipe: [1:7556256828309827386:5610]
2025-10-01T14:15:40.330944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:40.339186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.339220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.339384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.339444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.339508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.339564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.339741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.339751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.339813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.339870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.339930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.339988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.340033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.340044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.340109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.340170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.340233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.340295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.340339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.340346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.340408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.340466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.340538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.340598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.340644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.340651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.340710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.340771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.340835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.340896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.340939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.340948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.341010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.341068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.341125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.341186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.341232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.341238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.341301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.341355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.341417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.341479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.341522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.341529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.341593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.341656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.341721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.341784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.341826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.341832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.341891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.341947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.342006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.342061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.342103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.342109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.342168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.342222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.342281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.342340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.342397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.342404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.342470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827386:5610], now have 1 active actors on pipe
2025-10-01T14:15:40.343519Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:40.342632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256828309827386:5610]
2025-10-01T14:15:40.342666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:40.342671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:40.342697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2608 reason: error at write: Disconnected sessionId: src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0
2025-10-01T14:15:40.342707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:40.342894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2608 sessionId: src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0 is DEAD
2025-10-01T14:15:40.346617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:40.346628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Write session will restart in 0.009761s
2025-10-01T14:15:40.346655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Write session: Do CDS request
2025-10-01T14:15:40.346662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:40.357742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:40.357917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.357955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:40.357969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2609
2025-10-01T14:15:40.358154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.358185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:40.358194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:40.358197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:40.360014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:40.360084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2609 sessionId:  describe result for acl check
2025-10-01T14:15:40.360117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:40.360118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:40.360120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:40.360125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256828309827547:5695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:40.360207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:40.360218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:40.360228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:40.360277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:40.360313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256825932906139:6928]
2025-10-01T14:15:40.360605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256828309827547:5695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:40.360924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:40.361238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:40.361300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:40.361613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:40.361685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.361692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.361693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.361694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.361695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.361697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.361698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.361699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.361700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.361701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.361702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.361703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.361704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.361705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.361710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.361719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.361724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.361728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.361731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.361735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.361739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.361742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.361746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.361750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.361754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.361758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.361762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.361765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.361772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.361779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.361785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.361790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.361794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.361804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.361809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.361814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.361818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.361827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.361831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.361840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.361845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.361854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.361858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.361867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.361871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.361877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.361880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.361885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.361892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.361900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.361905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.361909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.361917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.361922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.361926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.361936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.361978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:40.363228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256828309827547:5695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:40.365567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:40.366498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:40.366511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:40.366514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:40.366517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:40.366524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2608 [2:7556256825932906139:6928]
2025-10-01T14:15:40.366541Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:40.366562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:40.366565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.366569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.366572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.366588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:40.366597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:40.366603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:40.366662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.366668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.366670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.366673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:40.366675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:40.366741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:40.366749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.366760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.366769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.366784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:40.366801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827389:2446], now have 1 active actors on pipe
2025-10-01T14:15:40.366814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.366819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.366821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.366834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:40.366847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:40.366849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:40.366853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:40.366855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:40.366865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:40.366868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:40.366900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.366910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:40.366917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:40.367121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2608
2025-10-01T14:15:40.367428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256828309827547:5695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:40.367441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256828309827547:5695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:40.367444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256828309827547:5695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:40.367452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:40.367935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2608
2025-10-01T14:15:40.367918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827587:5695], now have 1 active actors on pipe
2025-10-01T14:15:40.368106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.368116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.368142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:40.368154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.368164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.368167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:40.368177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.368192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:40.368212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.368431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.368438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.368451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.368563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2609 partition: 0 MaxSeqNo: 45 sessionId: src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0
2025-10-01T14:15:40.368918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3214dffd-32b470ff-662fdc7d-c54eae47_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:40.371474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Write session: try to update token
2025-10-01T14:15:40.371493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:40.380020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:40.380047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.380059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.380108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:40.380107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:40.380311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:40.380475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.380651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.380806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.381016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:40.381053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:40.388519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId: src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:40.391166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:40.391371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.391397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.391436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:40.391517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:40.402538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:40.402559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.402561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:40.402563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:40.402574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.402577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.402581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256825932906134:6928]
2025-10-01T14:15:40.402626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:40.402630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:40.402637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.402637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:40.402639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:40.402641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:40.402771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:40.442664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256828309827593:5610]
2025-10-01T14:15:40.442951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2608, pipe: [1:7556256828309827593:5610]
2025-10-01T14:15:40.551979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:40.559067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.559096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.559259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.559323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.559382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.559438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.559481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.559489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.559553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.559610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.559666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.559731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.559777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.559784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.559851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.559909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.559969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.560031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.560075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.560081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.560146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.560204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.560264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.560324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.560581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.560589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.560649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.560707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.560766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.560827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.560870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.560876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.560938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.560992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.561050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.561113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.561155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.561161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.561251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.561308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.561369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.561432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.561475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.561481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.561541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.561598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.561659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.561719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.561762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.561770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.561831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.561887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.561942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.562002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.562044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.562051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.562109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.562162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.562217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.562274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.562396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.562410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.562471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827593:5610], now have 1 active actors on pipe
2025-10-01T14:15:40.563013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:40.563027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:40.563052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2609 reason: error at write: Disconnected sessionId: src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0
2025-10-01T14:15:40.563297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2609 sessionId: src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0 is DEAD
2025-10-01T14:15:40.563398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:40.563463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256828309827593:5610]
2025-10-01T14:15:40.563483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:40.566459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:40.566469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Write session will restart in 0.008814s
2025-10-01T14:15:40.566494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Write session: Do CDS request
2025-10-01T14:15:40.566500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:40.576879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.577036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:40.577052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2610
2025-10-01T14:15:40.577171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.577210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:40.577220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:40.577223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:40.577583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2610 sessionId:  describe result for acl check
2025-10-01T14:15:40.577617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:40.577624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:40.577627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:40.577633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256828309827724:5701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:40.578116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256828309827724:5701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:40.580405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:40.580441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256828309827724:5701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:40.582513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:40.582690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:40.582699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:40.582710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:40.582757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:40.582793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256825932906364:6911]
2025-10-01T14:15:40.582976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256828309827724:5701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:40.582999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256828309827724:5701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:40.583003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256828309827724:5701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:40.583010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:40.583305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:40.583558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:40.583589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:40.583842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:40.583890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.583896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.583897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.583898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.583899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.583900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.583901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.583902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.583903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.583904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.583905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.583906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.583907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.583908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.583913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.583922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.583925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.583929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.583932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.583936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.583939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.583942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.583946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.583950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.583953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.583957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.583960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.583964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.583970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.583981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.583990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.584002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.584006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.584011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.584018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.584023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.584027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.584034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.584038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.584046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.584051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.584059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.584063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.584067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.584075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.584084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.584092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.584097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.584104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.584110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.584117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.584122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.584130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.584135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.584142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.584147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.584188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:40.587640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:40.588392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:40.588405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:40.588406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:40.588408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:40.588414Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2609 [2:7556256825932906364:6911]
2025-10-01T14:15:40.588424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:40.588437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:40.588439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.588441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.588442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.588452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:40.588463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:40.588467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:40.588505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.588509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.588511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.588513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:40.588514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:40.588587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:40.588596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.588606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.588615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.588623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:40.588637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827603:2446], now have 1 active actors on pipe
2025-10-01T14:15:40.588643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827793:5701], now have 1 active actors on pipe
2025-10-01T14:15:40.588648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.588650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.588651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.588660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:40.588671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:40.588673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:40.588675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:40.588677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:40.588686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:40.588689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:40.588714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.588726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:40.588743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:40.588933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2609
2025-10-01T14:15:40.588972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2609
2025-10-01T14:15:40.589018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.589033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.589060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:40.589073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.589081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.589083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:40.589093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.589108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:40.589125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.589287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.589298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.589318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.589394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2610 partition: 0 MaxSeqNo: 45 sessionId: src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0
2025-10-01T14:15:40.589747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34ffd8ad-f20e605e-86d7a2cf-f65614c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:40.592471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Write session: try to update token
2025-10-01T14:15:40.592488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:40.600215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:40.600234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.600244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.600287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:40.600285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:40.600459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:40.600619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.600762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.600901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:40.601090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:40.601134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:40.606543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId: src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:40.609309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:40.609586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.609611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.609658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:40.609758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:40.621245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:40.621274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.621276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:40.621279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:40.621290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.621294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.621300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256825932906359:6911]
2025-10-01T14:15:40.621337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:40.621347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:40.621353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:40.621355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.621357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:40.621358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:40.621491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:40.663859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256828309827809:5610]
2025-10-01T14:15:40.664141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2609, pipe: [1:7556256828309827809:5610]
2025-10-01T14:15:40.771256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:40.779449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.779484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.779647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.779709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.779771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.779834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.779878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.779887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.779953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.780019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.780084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.780157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.780202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.780209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.780279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.780345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.780415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.780481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.780546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.780554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.780630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.780694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.780762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.780834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.780880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.780887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.780971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.781044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.781121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.781192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.781238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.781246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.781330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.781403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.781481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.781557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.781609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.781620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.781693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.781753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.781815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.781877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.781922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.781925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.782004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.782075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.782148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.782222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.782269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.782273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.782357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.782533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.782622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.782702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.782746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.782749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.782826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:40.782884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:40.782950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:40.783037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:40.783095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:40.783098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:40.783162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827809:5610], now have 1 active actors on pipe
2025-10-01T14:15:40.784391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:40.785950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:40.786004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:40.786050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0
2025-10-01T14:15:40.786194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256828309827809:5610]
2025-10-01T14:15:40.786243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2610 sessionId: src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0 is DEAD
2025-10-01T14:15:40.787486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:40.787498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Write session will restart in 0.009439s
2025-10-01T14:15:40.787527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Write session: Do CDS request
2025-10-01T14:15:40.787533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:40.802647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:40.802663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2611
2025-10-01T14:15:40.802990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.803229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:40.803272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:40.803286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:40.803296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:40.803689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2611 sessionId:  describe result for acl check
2025-10-01T14:15:40.803720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:40.803721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:40.803723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:40.803728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256828309827963:5718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:40.804229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256828309827963:5718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:40.809873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:40.812350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:40.812590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:40.812594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:40.812605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:40.812655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:40.812690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256825932906574:6900]
2025-10-01T14:15:40.813235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:40.814056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:40.814111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:40.814431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:40.814486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.814492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.814493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.814494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.814496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.814497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.814499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.814500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.814501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.814502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.814503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.814504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.814505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.814506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.814511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.814519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.814522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.814526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.814529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.814532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.814535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.814538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.814541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.814545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.814548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.814552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.814555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.814558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.814564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.814571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:40.814576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.814580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:40.814584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.814589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:40.814593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.814597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:40.814602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.814607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:40.814610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.814614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:40.814619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.814623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:40.814627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.814632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:40.814635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.814640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:40.814644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.814648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.814652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.814657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.814661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.814666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.814670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.814675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:40.814679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.814683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:40.814715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:40.815396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256828309827963:5718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:40.820593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:40.821558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:40.821565Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:40.821568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:40.821571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:40.821579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2610 [2:7556256825932906574:6900]
2025-10-01T14:15:40.822016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256828309827963:5718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:40.822033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256828309827963:5718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:40.822036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256828309827963:5718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:40.822044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:40.821596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:40.821613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:40.821616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.821620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.821622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.821640Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:40.821646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:40.821651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:40.821710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.821712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.821715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.821718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:40.821721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:40.821795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:40.821797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.821810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:40.821822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:40.821836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:40.821852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.821854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.821857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.821866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:40.821880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:40.821883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:40.821888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:40.821891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:40.821895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:40.821898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:40.821909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309827812:2446], now have 1 active actors on pipe
2025-10-01T14:15:40.821946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.821957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:40.822063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:40.822402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2610
2025-10-01T14:15:40.824431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2610
2025-10-01T14:15:40.824440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309828009:5718], now have 1 active actors on pipe
2025-10-01T14:15:40.824473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.824480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.824507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:40.824535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:40.824542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:40.824545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:40.824556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:40.824572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:40.824591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.824746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.824752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.824768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:40.824828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2611 partition: 0 MaxSeqNo: 45 sessionId: src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0
2025-10-01T14:15:40.825217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9bfd54-d66b9cc-9ad70955-68cd90e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:40.827868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Write session: try to update token
2025-10-01T14:15:40.827887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:40.849520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId: src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:40.855300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:40.855328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:40.852334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:40.858359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:40.858410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:40.858413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:40.858416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:40.858418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:40.858427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.858431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.858435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256825932906567:6900]
2025-10-01T14:15:40.858490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:40.858497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:40.858500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:40.858650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:40.858772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:40.858776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:40.858780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:40.862096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:40.887256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256828309828018:5610]
2025-10-01T14:15:40.889177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2610, pipe: [1:7556256828309828018:5610]
2025-10-01T14:15:41.030240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:41.037824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.037850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.038014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.038088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.038148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.038222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.038269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.038277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.038345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.038428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.038496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.038563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.038606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.038612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.038671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.038736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.038804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.038870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.038921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.038927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.038993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.039057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.039127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.039183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.039223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.039229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.039288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.039345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.039401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.039472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.039518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.039526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.039592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.039649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.039707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.039781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.039831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.039840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.041440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:41.041444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256828309828018:5610]
2025-10-01T14:15:41.041454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:41.041464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:41.041488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2611 reason: error at write: Disconnected sessionId: src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0
2025-10-01T14:15:41.041665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2611 sessionId: src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0 is DEAD
2025-10-01T14:15:41.041820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:41.041842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Write session will restart in 0.006105s
2025-10-01T14:15:41.041870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Write session: Do CDS request
2025-10-01T14:15:41.041877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:41.039911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.039982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.040047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.040118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.040185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.040188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.040279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.040333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.040388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.040444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.040561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.040565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.040625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.040678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.040733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.040788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.040832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.040835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.040900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.040953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.041011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.041070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.041112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.041115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.041174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256828309828018:5610], now have 1 active actors on pipe
2025-10-01T14:15:41.042082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:41.048896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.049011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:41.049026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2612
2025-10-01T14:15:41.049163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.049198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:41.049209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:41.049213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:41.050045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2612 sessionId:  describe result for acl check
2025-10-01T14:15:41.050085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:41.050087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:41.050090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:41.050095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256832604795354:5730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:41.050619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256832604795354:5730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:41.053306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256832604795354:5730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:41.055800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256832604795354:5730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:41.055814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256832604795354:5730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:41.055817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256832604795354:5730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:41.055824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:41.057203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:41.059070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:41.059301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:41.059310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:41.059320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:41.059368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:41.059407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256830227874072:6892]
2025-10-01T14:15:41.060357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:41.060668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:41.060713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:41.061090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:41.061143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.061149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.061151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.061151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.061153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.061154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.061155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.061156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.061157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.061158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.061159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.061160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.061160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.061161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.061167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.061176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.061179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.061183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.061187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.061190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.061194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.061197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.061200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.061204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.061207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.061210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.061213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.061216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.061223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.061229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.061235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.061240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.061244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.061248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.061251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.061256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.061260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.061265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.061269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.061273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.061283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.061288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.061296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.061300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.061304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.061313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.061317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.061322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.061330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.061335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.061344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.061348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.061355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.061360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.061369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.061374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.061416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:41.065054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:41.065867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:41.065883Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:41.065885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:41.065889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:41.065896Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2611 [2:7556256830227874072:6892]
2025-10-01T14:15:41.065911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:41.065927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:41.065934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.065938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.065940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.065954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:41.065963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:41.065969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:41.066025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.066031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.066033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.066036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:41.066038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:41.066105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:41.066111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.066121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.066131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.066148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:41.066173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795321:2446], now have 1 active actors on pipe
2025-10-01T14:15:41.066176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795511:5730], now have 1 active actors on pipe
2025-10-01T14:15:41.066184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.066186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.066188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.066200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:41.066212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:41.066223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:41.066205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2611
2025-10-01T14:15:41.066225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:41.066244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2611
2025-10-01T14:15:41.066228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:41.066236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:41.066238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:41.066265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.066268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:41.066279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:41.066281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.066285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.066324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12fad064-322c0257-e11ebbb3-cf39b476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:41.066337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.066341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.066343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:41.066351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.066364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:41.066406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.066653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.066672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.066687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.066810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2612 partition: 0 MaxSeqNo: 45 sessionId: src_id|12fad064-322c0257-e11ebbb3-cf39b476_0
2025-10-01T14:15:41.067160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827e77c-425d0c71-34ea571e-bfcc5da6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|12fad064-322c0257-e11ebbb3-cf39b476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:41.069565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Write session: try to update token
2025-10-01T14:15:41.069584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:41.082760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId: src_id|12fad064-322c0257-e11ebbb3-cf39b476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:41.085541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:41.086790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.086817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.086838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:41.086841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:41.086844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:41.086845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:41.086854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.086858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.086862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256830227874067:6892]
2025-10-01T14:15:41.086920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:41.086927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.086929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:41.087072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:41.090466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:41.090474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:41.090477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:41.141535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256832604795538:5610]
2025-10-01T14:15:41.141818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2611, pipe: [1:7556256832604795538:5610]
2025-10-01T14:15:41.242852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:41.243379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:41.243426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795538:5610], now have 1 active actors on pipe
2025-10-01T14:15:41.244136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:41.244259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:41.244268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:41.244354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2612 reason: error at write: Disconnected sessionId: src_id|12fad064-322c0257-e11ebbb3-cf39b476_0
2025-10-01T14:15:41.244510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:41.244542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2612 sessionId: src_id|12fad064-322c0257-e11ebbb3-cf39b476_0 is DEAD
2025-10-01T14:15:41.244575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256832604795538:5610]
2025-10-01T14:15:41.246670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:41.246684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Write session will restart in 0.006029s
2025-10-01T14:15:41.246715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Write session: Do CDS request
2025-10-01T14:15:41.246726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:41.254788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.259430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:41.259448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2613
2025-10-01T14:15:41.259749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.259793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:41.259800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:41.259804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:41.260253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2613 sessionId:  describe result for acl check
2025-10-01T14:15:41.260287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:41.260289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:41.260295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:41.260301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256832604795637:5764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:41.260957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256832604795637:5764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:41.265049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256832604795637:5764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:41.270578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256832604795637:5764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:41.270598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256832604795637:5764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:41.270601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256832604795637:5764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:41.270611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:41.271175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:41.273717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:41.273933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:41.273936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:41.273946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:41.273996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:41.274031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256830227874280:6884]
2025-10-01T14:15:41.274505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:41.274875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:41.274914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:41.275149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:41.275187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.275189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.275189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.275190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.275191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.275192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.275193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.275194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.275194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.275195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.275196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.275197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.275197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.275198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.275202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.275209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.275212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.275214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.275217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.275219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.275221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.275223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.275225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.275228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.275230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.275232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.275235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.275237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.275242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.275247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.275251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.275254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.275257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.275260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.275263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.275266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.275269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.275273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.275275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.275279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.275283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.275286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.275289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.275293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.275296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.275300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.275303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.275306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.275309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.275312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.275314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.275317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.275320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.275323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.275326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.275329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.275351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:41.280208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:41.281009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:41.281026Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:41.281029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:41.281033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:41.281043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2612 [2:7556256830227874280:6884]
2025-10-01T14:15:41.281360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:41.281389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:41.281397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.281401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.281404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.281425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:41.281436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:41.281447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:41.281518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.281524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.281527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.281531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:41.281534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:41.281611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:41.281619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.281633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.281642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.281657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:41.281677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795566:2446], now have 1 active actors on pipe
2025-10-01T14:15:41.281686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.281689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.281691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.281701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:41.281707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:41.281709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:41.281711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:41.281718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:41.281732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:41.281736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:41.281742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795757:5764], now have 1 active actors on pipe
2025-10-01T14:15:41.281785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.281792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:41.282129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:41.282505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2612
2025-10-01T14:15:41.282550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2612
2025-10-01T14:15:41.286468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.286490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.286527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:41.286540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.286545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.286548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:41.286570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.286587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:41.286612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.287013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.287021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.287038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.287191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2613 partition: 0 MaxSeqNo: 45 sessionId: src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0
2025-10-01T14:15:41.290758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fad064-322c0257-e11ebbb3-cf39b476_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:41.294135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Write session: try to update token
2025-10-01T14:15:41.294156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:41.307049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:41.307073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:41.307076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:41.307078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:41.307090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.307096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.307101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256830227874273:6884]
2025-10-01T14:15:41.307152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:41.307160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.307167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:41.307305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:41.310932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:41.310951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:41.310955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:41.315660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId: src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:41.318478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:41.344822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256832604795770:5610]
2025-10-01T14:15:41.345103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2612, pipe: [1:7556256832604795770:5610]
2025-10-01T14:15:41.472937Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:41.473240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.473256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.473297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795770:5610], now have 1 active actors on pipe
2025-10-01T14:15:41.480802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:41.480817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Write session will restart in 0.009373s
2025-10-01T14:15:41.480845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Write session: Do CDS request
2025-10-01T14:15:41.480852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:41.480933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:41.480311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:41.480372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:41.480375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:41.480384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256832604795770:5610]
2025-10-01T14:15:41.480446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2613 reason: error at write: Disconnected sessionId: src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0
2025-10-01T14:15:41.480637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2613 sessionId: src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0 is DEAD
2025-10-01T14:15:41.491916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.491967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:41.491982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2614
2025-10-01T14:15:41.492143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.492172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:41.492177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:41.492180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:41.492574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2614 sessionId:  describe result for acl check
2025-10-01T14:15:41.492600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:41.492602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:41.492604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:41.492609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256832604795819:5770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:41.493220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256832604795819:5770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:41.497613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256832604795819:5770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:41.503419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256832604795819:5770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:41.503437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256832604795819:5770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:41.503440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256832604795819:5770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:41.503449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:41.503861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:41.506487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:41.506709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:41.506723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:41.506735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:41.506805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:41.506839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256830227874482:6872]
2025-10-01T14:15:41.507428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:41.507955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:41.508013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:41.508357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:41.508420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.508426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.508428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.508429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.508430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.508431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.508432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.508433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.508434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.508436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.508437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.508438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.508440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.508441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.508446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.508456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.508460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.508464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.508468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.508472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.508475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.508479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.508482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.508486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.508490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.508494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.508497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.508501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.508510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.508533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.508540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.508545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.508550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.508556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.508559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.508565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.508570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.508575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.508579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.508583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.508588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.508593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.508597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.508606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.508611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.508616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.508624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.508629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.508634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.508639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.508647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.508652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.508657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.508666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.508670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.508675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.508717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:41.526908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:41.527586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:41.527593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:41.527596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:41.527599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:41.527607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2613 [2:7556256830227874482:6872]
2025-10-01T14:15:41.527623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:41.527641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:41.527644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.527648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.527651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.527669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:41.527675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:41.527681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:41.527745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.527747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.527749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.527752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:41.527755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:41.527838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:41.527841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.527853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.527864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.527880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:41.527897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.527900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.527903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.527919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:41.527934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:41.527949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:41.527952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:41.527990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.527993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:41.528174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:41.528184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:41.528187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:41.528193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:41.528415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795968:5770], now have 1 active actors on pipe
2025-10-01T14:15:41.528420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795773:2446], now have 1 active actors on pipe
2025-10-01T14:15:41.528979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2613
2025-10-01T14:15:41.529010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2613
2025-10-01T14:15:41.530700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.530717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.530751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:41.530766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.530771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.530774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:41.530784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.530798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:41.530817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.531203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.531211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.531226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.531346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2614 partition: 0 MaxSeqNo: 45 sessionId: src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0
2025-10-01T14:15:41.531708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826d79d1-a603fb91-45ca55b9-dec799cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:41.534270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Write session: try to update token
2025-10-01T14:15:41.534288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:41.556834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId: src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:41.559413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:41.560015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.560038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.560075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:41.560290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:41.580840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256832604795985:5610]
2025-10-01T14:15:41.582002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:41.582023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:41.582026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:41.582027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:41.582036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.582040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.582044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256830227874476:6872]
2025-10-01T14:15:41.582087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:41.582093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.582095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:41.582225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:41.583777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:41.583792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:41.583795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:41.584574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2613, pipe: [1:7556256832604795985:5610]
2025-10-01T14:15:41.736412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:41.737101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795985:5610], now have 1 active actors on pipe
2025-10-01T14:15:41.744919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.744954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.745128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.745189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.745252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.745317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.745363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.745368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.745445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.745500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.745558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.745623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.745664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.745666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.745738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.745794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.745854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.745913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.746117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.746120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.746198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.746953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.747024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.747084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.747125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.747128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.747201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.747267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.747332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.747395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.747438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.747443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.747522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.747585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.747649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.747716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.747766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.747769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.747841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.747905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.747975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.748042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.748094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.748097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.748167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.748231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.748300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.748365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.748411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.748414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.748490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.748565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.748635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.748697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.748742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.748745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.748809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.748869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.748934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.748997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.749039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.749045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.750260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:41.750277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:41.750306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2614 reason: error at write: Disconnected sessionId: src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0
2025-10-01T14:15:41.750641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2614 sessionId: src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0 is DEAD
2025-10-01T14:15:41.750812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256832604795985:5610]
2025-10-01T14:15:41.750832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:41.750288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:41.752733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:41.752745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Write session will restart in 0.005763s
2025-10-01T14:15:41.752769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Write session: Do CDS request
2025-10-01T14:15:41.752775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:41.759940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.760025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:41.760039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2615
2025-10-01T14:15:41.760246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:41.760276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:41.760282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:41.760285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:41.760799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2615 sessionId:  describe result for acl check
2025-10-01T14:15:41.760833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:41.760836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:41.760838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:41.760844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256832604796009:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:41.761360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256832604796009:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:41.766917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256832604796009:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:41.772108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256832604796009:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:41.772122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256832604796009:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:41.772125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256832604796009:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:41.772132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:41.779554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:41.782141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:41.782357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:41.782361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:41.782392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:41.782445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:41.782480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256830227874724:6864]
2025-10-01T14:15:41.783132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:41.783753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:41.783791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:41.784009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:41.784041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.784042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.784042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.784043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.784044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.784045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.784046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.784047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.784047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.784048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.784049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.784049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.784050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.784051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.784055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.784062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.784064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.784067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.784069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.784072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.784074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.784076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.784079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.784081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.784083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.784085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.784087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.784089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.784094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.784099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:41.784103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.784107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:41.784109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.784112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:41.784116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.784119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:41.784122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.784125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:41.784128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.784130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:41.784134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.784136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:41.784139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.784142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:41.784145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.784148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:41.784150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.784153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.784158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.784161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.784163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.784166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.784169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.784172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:41.784174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.784177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:41.784201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:41.789493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:41.790067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:41.790072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:41.790074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:41.790077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:41.790082Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2614 [2:7556256830227874724:6864]
2025-10-01T14:15:41.790095Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:41.790108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:41.790110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.790112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.790114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.790127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:41.790131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:41.790135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:41.790281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.790291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.790293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.790296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:41.790299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:41.790360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:41.790362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.790393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:41.790404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:41.790420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:41.790437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.790439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.790442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.790457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:41.790473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:41.790489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:41.790491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:41.790492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:41.790495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:41.790498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:41.790530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.790540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:41.790574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:41.790728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604796122:5788], now have 1 active actors on pipe
2025-10-01T14:15:41.790738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604795995:2446], now have 1 active actors on pipe
2025-10-01T14:15:41.790846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2614
2025-10-01T14:15:41.790870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2614
2025-10-01T14:15:41.791083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.791092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.791119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:41.791130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:41.791135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:41.791142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:41.791153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:41.791167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:41.791187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.791408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.791416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.791430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:41.791538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2615 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0
2025-10-01T14:15:41.791860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518ebb0c-ddb106a-7ffe0108-b0b72e52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:41.794398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Write session: try to update token
2025-10-01T14:15:41.794417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:41.809073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:41.809096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:41.809107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.809152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:41.809176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:41.809311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:41.809443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:41.809571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:41.809704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:41.809990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:41.810032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:41.811819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId: src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:41.814141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:41.814781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.814802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.814833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:41.814933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:41.832900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:41.832925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:41.832928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:41.832930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:41.832941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.832948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.832952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256830227874718:6864]
2025-10-01T14:15:41.833001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:41.833008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:41.833010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:41.833152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:41.834441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:41.834449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:41.834456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:41.854506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256832604796201:5610]
2025-10-01T14:15:41.854762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2614, pipe: [1:7556256832604796201:5610]
2025-10-01T14:15:41.990920Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:41.999296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:41.999329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:41.999493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.999544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.999606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.999661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.999701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.999706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:41.999770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:41.999825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:41.999881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:41.999938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:41.999975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:41.999977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.000040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.000090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.000144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.000198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.000239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.000242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.000305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.000364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.000420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.000476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.000516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.000529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.000597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.000652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.000708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.000763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.000821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.000825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.000896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.000961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.001021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.001079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.001124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.001126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.001194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.001254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.001313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.001375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.001418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.001420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.001485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.001539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.001596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.001659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.001700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.001703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.001772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.001828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.001887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.001942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.001982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.001985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.002049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.002108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.002165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.002226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.002268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.002272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.002362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256832604796201:5610], now have 1 active actors on pipe
2025-10-01T14:15:42.002601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:42.003646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:42.003706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0
2025-10-01T14:15:42.004061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:42.004073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Write session will restart in 0.005255s
2025-10-01T14:15:42.004099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Write session: Do CDS request
2025-10-01T14:15:42.004105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:42.003912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2615 sessionId: src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0 is DEAD
2025-10-01T14:15:42.004101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:42.004148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256832604796201:5610]
2025-10-01T14:15:42.010862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.011700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:42.011715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2616
2025-10-01T14:15:42.011859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.011916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:42.011925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:42.011928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:42.013142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2616 sessionId:  describe result for acl check
2025-10-01T14:15:42.013175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:42.013176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:42.013178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:42.013182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256836899763527:5783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:42.013627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256836899763527:5783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:42.021409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256836899763527:5783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:42.026953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256836899763527:5783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:42.026969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256836899763527:5783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:42.026973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256836899763527:5783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:42.026981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:42.027465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:42.032580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:42.032962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:42.032967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:42.032982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:42.033057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:42.033093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256834522842227:6847]
2025-10-01T14:15:42.033667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:42.033972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:42.034012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:42.034317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:42.034368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.034382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.034384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.034385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.034387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.034388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.034389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.034391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.034392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.034393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.034394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.034396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.034397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.034398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.034403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.034413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.034416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.034420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.034423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.034426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.034430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.034433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.034436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.034440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.034443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.034446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.034449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.034453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.034459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.034467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.034472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.034478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.034481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.034486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.034490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.034495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.034499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.034504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.034516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.034521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.034525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.034530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.034533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.034538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.034544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.034548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.034554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.034559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.034562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.034567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.034571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.034576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.034581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.034586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.034589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.034595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.034632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:42.041848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2615
2025-10-01T14:15:42.041894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2615
2025-10-01T14:15:42.042694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2616 partition: 0 MaxSeqNo: 45 sessionId: src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0
2025-10-01T14:15:42.044737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa933ab2-c8e4b3c1-9cd4df81-6a230d0b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:42.040114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:42.041107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:42.041112Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:42.041115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:42.041118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:42.041125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2615 [2:7556256834522842227:6847]
2025-10-01T14:15:42.041141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:42.041158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:42.041161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.041164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.041167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.041182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:42.041187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:42.041193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:42.041252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.041254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.041257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.041260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:42.041263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:42.041327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:42.041330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.041341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.041352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.041367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:42.041383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.041386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.041388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.041401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:42.041412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:42.041425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:42.041427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:42.041461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.041463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:42.041520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:42.041521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:42.041523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:42.041528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:42.041813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763503:2446], now have 1 active actors on pipe
2025-10-01T14:15:42.041817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763700:5783], now have 1 active actors on pipe
2025-10-01T14:15:42.042266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.042271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.042296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:42.042305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.042309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.042311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:42.042320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.042330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:42.042343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.042599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.042603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.042617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.047460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Write session: try to update token
2025-10-01T14:15:42.047480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:42.063970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:42.063991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:42.063994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:42.063996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:42.064006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.064010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.064014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256834522842222:6847]
2025-10-01T14:15:42.064061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:42.064067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.064070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:42.064223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:42.064566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:42.064572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:42.064579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:42.066127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId: src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:42.068562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:42.106106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256836899763713:5610]
2025-10-01T14:15:42.107130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2615, pipe: [1:7556256836899763713:5610]
2025-10-01T14:15:42.215965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:42.216616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.216636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.216676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763713:5610], now have 1 active actors on pipe
2025-10-01T14:15:42.216893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:42.222086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:42.222099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Write session will restart in 0.005162s
2025-10-01T14:15:42.221620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:42.222125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Write session: Do CDS request
2025-10-01T14:15:42.221674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:42.221750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0
2025-10-01T14:15:42.222132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:42.221912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2616 sessionId: src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0 is DEAD
2025-10-01T14:15:42.222067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256836899763713:5610]
2025-10-01T14:15:42.228896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.228969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:42.228986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2617
2025-10-01T14:15:42.229101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.229136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:42.229141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:42.229145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:42.230788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2617 sessionId:  describe result for acl check
2025-10-01T14:15:42.230826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:42.230832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:42.230834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:42.230839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256836899763750:5814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:42.231335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256836899763750:5814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:42.235010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256836899763750:5814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:42.237346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256836899763750:5814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:42.237358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256836899763750:5814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:42.237361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256836899763750:5814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:42.237366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:42.251963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:42.254918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:42.255136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:42.255141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:42.255152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:42.255197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:42.255230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256834522842437:6855]
2025-10-01T14:15:42.255808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:42.256121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:42.256165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:42.256464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:42.256527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.256529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.256530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.256531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.256532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.256534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.256535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.256536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.256537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.256538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.256539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.256541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.256542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.256543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.256548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.256557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.256561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.256564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.256568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.256571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.256574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.256577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.256595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.256599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.256602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.256606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.256609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.256613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.256620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.256626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.256632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.256636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.256640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.256644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.256648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.256652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.256656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.256661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.256664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.256669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.256674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.256678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.256682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.256686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.256690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.256695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.256701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.256705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.256709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.256713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.256716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.256721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.256725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.256729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.256733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.256738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.256777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:42.261580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:42.262631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2616
2025-10-01T14:15:42.262673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2616
2025-10-01T14:15:42.262239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:42.262255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:42.262258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:42.262261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:42.262267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2616 [2:7556256834522842437:6855]
2025-10-01T14:15:42.262283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:42.262298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:42.262300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.262304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.262306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.262320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:42.262325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:42.262332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:42.262402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.262404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.262406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.262409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:42.262412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:42.262479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:42.262481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.262492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.262504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.262521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:42.262538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763745:2446], now have 1 active actors on pipe
2025-10-01T14:15:42.262542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763798:5814], now have 1 active actors on pipe
2025-10-01T14:15:42.262549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.262551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.262553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.262566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:42.262579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:42.262581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:42.262583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:42.262585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:42.262593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:42.262596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:42.262621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.262627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:42.262632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:42.262821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.262828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.262855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:42.262863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.262866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.262869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:42.262880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.262897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:42.262913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.263249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2617 partition: 0 MaxSeqNo: 45 sessionId: src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0
2025-10-01T14:15:42.263639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5add9c-53c9dbb2-ee9c70bb-6e416552_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:42.263109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.263121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.263140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.266326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Write session: try to update token
2025-10-01T14:15:42.266343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:42.288642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:42.288665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:42.288668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:42.288670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:42.288680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.288685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.288689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256834522842432:6855]
2025-10-01T14:15:42.288742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:42.288745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:42.288753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:42.288753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.288756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:42.288757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:42.288898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:42.293887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId: src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:42.296325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:42.322796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256836899763965:5610]
2025-10-01T14:15:42.323339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2616, pipe: [1:7556256836899763965:5610]
2025-10-01T14:15:42.437915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:42.438219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.438243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.438265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763965:5610], now have 1 active actors on pipe
2025-10-01T14:15:42.438494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:42.438539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:42.438591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:42.438599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:42.438658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2617 reason: error at write: Disconnected sessionId: src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0
2025-10-01T14:15:42.438828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256836899763965:5610]
2025-10-01T14:15:42.438858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2617 sessionId: src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0 is DEAD
2025-10-01T14:15:42.439279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:42.439296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Write session will restart in 0.006328s
2025-10-01T14:15:42.439324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Write session: Do CDS request
2025-10-01T14:15:42.439330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:42.446864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.446929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:42.446942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2618
2025-10-01T14:15:42.447046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.447079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:42.447086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:42.447089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:42.447452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2618 sessionId:  describe result for acl check
2025-10-01T14:15:42.447481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:42.447487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:42.447489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:42.447493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256836899763983:5827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:42.447993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256836899763983:5827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:42.451797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256836899763983:5827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:42.455115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256836899763983:5827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:42.455130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256836899763983:5827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:42.455134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256836899763983:5827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:42.455142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:42.459932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:42.462342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:42.462551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:42.462562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:42.462573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:42.462623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:42.462656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256834522842643:6852]
2025-10-01T14:15:42.463224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:42.463498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:42.463540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:42.463829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:42.463880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.463887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.463888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.463889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.463890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.463892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.463893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.463894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.463895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.463896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.463897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.463898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.463899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.463900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.463904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.463915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.463919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.463923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.463927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.463931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.463935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.463939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.463942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.463946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.463950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.463957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.463960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.463967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.463974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.463980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.463985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.463989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.463994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.463999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.464004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.464009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.464015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.464018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.464023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.464028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.464033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.464038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.464043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.464047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.464053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.464059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.464064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.464069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.464074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.464078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.464082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.464087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.464091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.464095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.464100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.464139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:42.467766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:42.468449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:42.468463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:42.468466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:42.468470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:42.468477Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2617 [2:7556256834522842643:6852]
2025-10-01T14:15:42.468492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:42.468513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:42.468527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.468531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.468533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.468547Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:42.468556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:42.468562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:42.468621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.468627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.468630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.468634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:42.468637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:42.468698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:42.468705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.468714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.468728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.468747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:42.468767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764104:5827], now have 1 active actors on pipe
2025-10-01T14:15:42.468775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899763968:2446], now have 1 active actors on pipe
2025-10-01T14:15:42.468782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.468788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.468790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.468802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:42.468819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:42.468820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:42.468822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:42.468824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:42.468832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:42.468838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:42.468866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.468879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:42.468884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:42.468869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2617
2025-10-01T14:15:42.468906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2617
2025-10-01T14:15:42.469041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.469052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.469080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:42.469099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.469107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.469110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:42.469121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.469134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:42.469152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.469321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.469332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.469363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.469468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2618 partition: 0 MaxSeqNo: 45 sessionId: src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0
2025-10-01T14:15:42.469811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730dd13c-1e69458e-8c80b601-67ada5a9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:42.472404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Write session: try to update token
2025-10-01T14:15:42.472422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:42.488767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId: src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:42.491571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:42.493523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.493554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.493576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:42.493580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:42.493582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:42.493584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:42.493593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.493598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.493602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256834522842638:6852]
2025-10-01T14:15:42.493650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:42.493657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:42.493661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:42.493662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:42.493669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.493671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:42.493804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:42.536983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256836899764183:5610]
2025-10-01T14:15:42.537250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2617, pipe: [1:7556256836899764183:5610]
2025-10-01T14:15:42.641690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:42.641923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:42.641972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764183:5610], now have 1 active actors on pipe
2025-10-01T14:15:42.642122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:42.642207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:42.642247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256836899764183:5610]
2025-10-01T14:15:42.642264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:42.642266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:42.642280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2618 reason: error at write: Disconnected sessionId: src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0
2025-10-01T14:15:42.642527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2618 sessionId: src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0 is DEAD
2025-10-01T14:15:42.643020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:42.643032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Write session will restart in 0.009474s
2025-10-01T14:15:42.643056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Write session: Do CDS request
2025-10-01T14:15:42.643064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:42.653886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.653957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:42.653971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2619
2025-10-01T14:15:42.654128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.654169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:42.654175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:42.654179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:42.654618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2619 sessionId:  describe result for acl check
2025-10-01T14:15:42.654650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:42.654654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:42.654656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:42.654660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256836899764326:5841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:42.655199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256836899764326:5841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:42.657194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256836899764326:5841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:42.657864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:42.661564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:42.661368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256836899764326:5841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:42.661380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256836899764326:5841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:42.661383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256836899764326:5841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:42.661391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:42.661772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:42.661784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:42.661795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:42.661847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:42.661894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256834522842879:6828]
2025-10-01T14:15:42.662458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:42.662759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:42.662812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:42.663073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:42.663146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.663151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.663153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.663154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.663155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.663156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.663157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.663158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.663159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.663160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.663161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.663162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.663164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.663165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.663171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.663180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.663184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.663188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.663191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.663195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.663199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.663203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.663207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.663212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.663215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.663218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.663222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.663226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.663237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.663248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.663257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.663262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.663267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.663276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.663284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.663290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.663298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.663304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.663311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.663316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.663323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.663331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.663335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.663340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.663345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.663349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.663354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.663360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.663365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.663371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.663378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.663383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.663389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.663398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.663402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.663410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.663448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:42.667740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:42.668343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:42.668357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:42.668359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:42.668362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:42.668369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2618 [2:7556256834522842879:6828]
2025-10-01T14:15:42.668383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:42.668397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:42.668399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.668403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.668405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.668419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:42.668430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:42.668435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:42.668491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.668493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.668495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.668498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:42.668501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:42.668650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:42.668653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.668664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.668674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.668688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:42.668705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764196:2446], now have 1 active actors on pipe
2025-10-01T14:15:42.668709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764395:5841], now have 1 active actors on pipe
2025-10-01T14:15:42.668716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.668718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.668720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.668734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:42.668742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:42.668745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:42.668748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:42.668749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:42.668762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:42.668765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:42.668793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.668801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:42.668835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:42.668918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2618
2025-10-01T14:15:42.668953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2618
2025-10-01T14:15:42.669154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.669168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.669195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:42.669206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.669211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.669214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:42.669223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.669234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:42.669249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.669896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2619 partition: 0 MaxSeqNo: 45 sessionId: src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0
2025-10-01T14:15:42.670218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21d918-8bd51b09-d97ac0e5-c274a17a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:42.669594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.669606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.669622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.672792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Write session: try to update token
2025-10-01T14:15:42.672810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:42.689516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId: src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:42.692089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:42.692354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.692375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.692415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:42.694735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:42.699757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:42.699776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:42.699778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:42.699780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:42.699789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.699794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.699798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256834522842873:6828]
2025-10-01T14:15:42.699831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:42.699837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:42.699840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:42.699843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:42.699850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.699857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:42.699990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:42.738425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256836899764408:5610]
2025-10-01T14:15:42.738668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2618, pipe: [1:7556256836899764408:5610]
2025-10-01T14:15:42.849917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:42.859161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.859188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.859353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.859409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.859477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.859536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.859947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.859960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.860031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.860090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.860150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.860215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.860256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.860267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.860328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.860376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.860425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.860477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.860515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.860529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.860595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.860645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.860698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.860752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.860790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.860794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.860856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.860908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.860957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.861011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.861048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.861050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.861117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.861176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.861238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.861295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.861335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.861338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.861404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.861463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.861527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.861582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.861627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.861629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.861691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.861747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.861804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.861860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.861900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.861902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.861965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.862020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.862077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.862132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.862172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.862175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.862240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:42.862297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:42.862354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:42.862892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:42.862943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:42.862951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:42.863022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764408:5610], now have 1 active actors on pipe
2025-10-01T14:15:42.863286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:42.863350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:42.863353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:42.863380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2619 reason: error at write: Disconnected sessionId: src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0
2025-10-01T14:15:42.863608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2619 sessionId: src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0 is DEAD
2025-10-01T14:15:42.863703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:42.863714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Write session will restart in 0.006584s
2025-10-01T14:15:42.863740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Write session: Do CDS request
2025-10-01T14:15:42.863745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:42.863799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256836899764408:5610]
2025-10-01T14:15:42.864020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:42.871926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.871969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:42.871982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2620
2025-10-01T14:15:42.872145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:42.872184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:42.872193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:42.872196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:42.872619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2620 sessionId:  describe result for acl check
2025-10-01T14:15:42.872650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:42.872655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:42.872657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:42.872661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256836899764443:5855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:42.873418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256836899764443:5855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:42.876132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256836899764443:5855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:42.883105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256836899764443:5855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:42.883120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256836899764443:5855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:42.883123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256836899764443:5855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:42.883131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:42.882984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:42.885604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:42.885786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:42.885796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:42.885805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:42.885844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:42.885883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256834522843099:6825]
2025-10-01T14:15:42.886482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:42.886762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:42.886796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:42.887082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:42.887123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.887128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.887129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.887130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.887131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.887132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.887133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.887134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.887135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.887136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.887137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.887138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.887139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.887140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.887144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.887152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.887155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.887158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.887161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.887164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.887167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.887170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.887173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.887177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.887179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.887183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.887185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.887188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.887194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.887200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:42.887204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.887209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:42.887212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.887217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:42.887220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.887225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:42.887229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.887233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:42.887236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.887240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:42.887245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.887249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:42.887253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.887257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:42.887260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.887264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:42.887267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.887271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.887274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.887278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.887282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.887286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.887290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.887294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:42.887298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.887302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:42.887332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:42.891494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:42.892490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:42.892536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:42.892544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:42.892547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:42.892554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2619 [2:7556256834522843099:6825]
2025-10-01T14:15:42.892569Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:42.892589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:42.892597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.892600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.892602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.892618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:42.892624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:42.892635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:42.892691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.892699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.892701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.892704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:42.892707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:42.892882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2619
2025-10-01T14:15:42.892895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2619
2025-10-01T14:15:42.892770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:42.892780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.892792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:42.892803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:42.892818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:42.892838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764611:5855], now have 1 active actors on pipe
2025-10-01T14:15:42.892842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764410:2446], now have 1 active actors on pipe
2025-10-01T14:15:42.892848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.892851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.892853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.892869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:42.892879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:42.892882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:42.892883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:42.892884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:42.892898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:42.892901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:42.892929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.892932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:42.892934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:42.892954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.892959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.893012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:42.893019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:42.893023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:42.893025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:42.893034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:42.893043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:42.893063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.893238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:42.893248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:42.893268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:42.893343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2620 partition: 0 MaxSeqNo: 45 sessionId: src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0
2025-10-01T14:15:42.893644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64c77f3-4820370b-c5ac6033-71d341f7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:42.896205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Write session: try to update token
2025-10-01T14:15:42.896223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:42.915694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:42.915711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:42.915714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:42.915716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:42.915726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.915730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.915734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256834522843092:6825]
2025-10-01T14:15:42.915779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:42.915779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:42.915785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:42.915786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:42.915788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:42.915792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:42.915933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:42.921627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId: src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:42.924070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:42.963756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256836899764625:5610]
2025-10-01T14:15:42.964030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2619, pipe: [1:7556256836899764625:5610]
2025-10-01T14:15:43.067792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:43.068693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256836899764625:5610]
2025-10-01T14:15:43.068732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:43.068814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2620 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0
2025-10-01T14:15:43.068089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.068103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.068124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256836899764625:5610], now have 1 active actors on pipe
2025-10-01T14:15:43.068373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:43.069163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:43.069173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Write session will restart in 0.006065s
2025-10-01T14:15:43.069208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Write session: Do CDS request
2025-10-01T14:15:43.069214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:43.068969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:43.069024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2620 sessionId: src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0 is DEAD
2025-10-01T14:15:43.076922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.077037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:43.077053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2621
2025-10-01T14:15:43.077219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.077252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:43.077262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:43.077265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:43.077701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2621 sessionId:  describe result for acl check
2025-10-01T14:15:43.077737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:43.077738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:43.077740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:43.077744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256841194731948:5869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:43.078265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256841194731948:5869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:43.080739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256841194731948:5869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:43.084221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256841194731948:5869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:43.084233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256841194731948:5869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:43.084236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256841194731948:5869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:43.084246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:43.088445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:43.090903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:43.091170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:43.091182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:43.091196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:43.091266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:43.091312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256838817810602:6817]
2025-10-01T14:15:43.091914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:43.092260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:43.092313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:43.092634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:43.092709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.092715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.092716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.092717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.092718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.092719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.092720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.092722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.092723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.092724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.092726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.092727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.092728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.092729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.092735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.092746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.092750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.092754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.092759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.092763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.092766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.092770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.092774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.092778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.092782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.092785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.092789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.092792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.092799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.092811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.092821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.092827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.092836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.092841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.092849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.092854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.092858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.092863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.092867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.092871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.092878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.092883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.092887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.092892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.092896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.092901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.092906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.092912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.092917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.092923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.092932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.092937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.092946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.092951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.092955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.092965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.093005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:43.097611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:43.098614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:43.098633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:43.098636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:43.098639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:43.098646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2620 [2:7556256838817810602:6817]
2025-10-01T14:15:43.098669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:43.098686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:43.098694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.098698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.098701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.098718Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:43.098727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:43.098734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:43.098791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.098799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.098801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.098804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:43.098807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:43.098877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:43.098885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.098897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.098910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.098929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:43.098946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.098948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.098950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.098967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:43.098981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:43.098994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:43.098997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:43.099005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:43.099009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:43.099012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:43.099030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.099033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:43.099085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:43.099206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732108:5869], now have 1 active actors on pipe
2025-10-01T14:15:43.099215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194731925:2446], now have 1 active actors on pipe
2025-10-01T14:15:43.099564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.099577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.099500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2620
2025-10-01T14:15:43.099606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:43.099538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2620
2025-10-01T14:15:43.099618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.099626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.099629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:43.099639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.099654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:43.099674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.099809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.099819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.099842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.100002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2621 partition: 0 MaxSeqNo: 45 sessionId: src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0
2025-10-01T14:15:43.100511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a9a4d9-c2b25dfa-ec6f903d-311694bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:43.103018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Write session: try to update token
2025-10-01T14:15:43.103034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:43.124264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId: src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:43.124792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:43.124805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:43.124808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:43.124810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:43.124820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.124825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.124829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256838817810597:6817]
2025-10-01T14:15:43.124883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:43.124893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.124895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:43.124964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:43.124977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:43.124981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:43.125023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:43.126807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:43.168565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256841194732153:5610]
2025-10-01T14:15:43.168828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2620, pipe: [1:7556256841194732153:5610]
2025-10-01T14:15:43.271452Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:43.271721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.271731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.271774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732153:5610], now have 1 active actors on pipe
2025-10-01T14:15:43.272003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:43.272332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:43.272407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2621 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0
2025-10-01T14:15:43.272760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:43.272773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Write session will restart in 0.009217s
2025-10-01T14:15:43.272807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Write session: Do CDS request
2025-10-01T14:15:43.272812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:43.272592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2621 sessionId: src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0 is DEAD
2025-10-01T14:15:43.272758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256841194732153:5610]
2025-10-01T14:15:43.272772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:43.282858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.282940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:43.282954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2622
2025-10-01T14:15:43.283117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.283153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:43.283162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:43.283165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:43.283686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2622 sessionId:  describe result for acl check
2025-10-01T14:15:43.283725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:43.283731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:43.283733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:43.283739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256841194732270:5901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:43.284315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256841194732270:5901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:43.288367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256841194732270:5901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:43.288564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:43.292502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:43.292583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256841194732270:5901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:43.292599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256841194732270:5901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:43.292602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256841194732270:5901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:43.292615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:43.292717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:43.292726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:43.292736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:43.292788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:43.292822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256838817810818:6815]
2025-10-01T14:15:43.293373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:43.293704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:43.293763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:43.294066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:43.294128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.294129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.294130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.294131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.294132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.294133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.294134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.294135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.294136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.294137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.294138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.294141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.294143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.294143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.294148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.294157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.294160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.294163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.294165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.294168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.294171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.294175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.294178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.294182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.294185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.294189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.294192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.294195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.294202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.294211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.294217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.294222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.294226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.294231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.294238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.294243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.294249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.294254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.294258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.294263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.294267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.294273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.294277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.294281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.294285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.294289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.294292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.294297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.294300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.294304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.294308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.294312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.294315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.294319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.294322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.294328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.294359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:43.300044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:43.300717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:43.300729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:43.300732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:43.300735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:43.300741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2621 [2:7556256838817810818:6815]
2025-10-01T14:15:43.300755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:43.300773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:43.300776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.300779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.300782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.300798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:43.300803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:43.300809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:43.300867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.300869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.300871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.300874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:43.300877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:43.300939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:43.300947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.300958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.300967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.300985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:43.301005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.301010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.301012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.301258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2621
2025-10-01T14:15:43.301296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2621
2025-10-01T14:15:43.301025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:43.301041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:43.301055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:43.301058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:43.301066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:43.301068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:43.301070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:43.301091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.301094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:43.301145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:43.301223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732171:2446], now have 1 active actors on pipe
2025-10-01T14:15:43.301230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732379:5901], now have 1 active actors on pipe
2025-10-01T14:15:43.301583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.301592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.301618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:43.301640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.301647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.301649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:43.301659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.301671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:43.301687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.301882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.301887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.301899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.302030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2622 partition: 0 MaxSeqNo: 45 sessionId: src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0
2025-10-01T14:15:43.303672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd790a4-2999ea32-a0839a3a-c218fbcd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:43.306488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Write session: try to update token
2025-10-01T14:15:43.306510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:43.321827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId: src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:43.324902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:43.325118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.325137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.325190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:43.328492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:43.328509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:43.328511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:43.328514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:43.328536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.328542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.328546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256838817810813:6815]
2025-10-01T14:15:43.328592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:43.328600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.328603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:43.328654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:43.328666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:43.328670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:43.328754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:43.325304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:43.373053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256841194732391:5610]
2025-10-01T14:15:43.373286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2621, pipe: [1:7556256841194732391:5610]
2025-10-01T14:15:43.477530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:43.485947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.485978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.486153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.486227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.486301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.486443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.486946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.486966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.487038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.487106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.487176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.487245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.487292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.487301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.487363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.487426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.487485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.487541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.487578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.487581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.487646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.487712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.487768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.487823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.487861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.487866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.487929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.487983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.488042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.488103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.488141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.488143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.488214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.488278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.488343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.488409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.488453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.488455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.488544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.488606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.488666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.488728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.488825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.488829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.488898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.488954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.489013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.489071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.489109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.489112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.489176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.489233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.489293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.489351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.489394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.489397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.489465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.489524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.489585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.489645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.489690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.489694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.489764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732391:5610], now have 1 active actors on pipe
2025-10-01T14:15:43.490610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:43.490651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256841194732391:5610]
2025-10-01T14:15:43.490666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:43.490668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:43.490695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2622 reason: error at write: Disconnected sessionId: src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0
2025-10-01T14:15:43.491147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:43.491157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Write session will restart in 0.005124s
2025-10-01T14:15:43.491181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Write session: Do CDS request
2025-10-01T14:15:43.491186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:43.490826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:43.490870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2622 sessionId: src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0 is DEAD
2025-10-01T14:15:43.497835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.499283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:43.499302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2623
2025-10-01T14:15:43.500176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.500222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:43.500233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:43.500236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:43.500670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2623 sessionId:  describe result for acl check
2025-10-01T14:15:43.500702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:43.500708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:43.500710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:43.500716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256841194732420:5915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:43.501211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256841194732420:5915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:43.504940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256841194732420:5915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:43.508310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256841194732420:5915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:43.508329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256841194732420:5915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:43.508332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256841194732420:5915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:43.508343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:43.510498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:43.512773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:43.513095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:43.513105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:43.513117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:43.513184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:43.513224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256838817811030:6796]
2025-10-01T14:15:43.513839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:43.514097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:43.514135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:43.514446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:43.514496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.514501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.514503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.514504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.514505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.514506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.514507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.514508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.514510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.514511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.514512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.514513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.514514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.514515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.514520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.514530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.514534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.514538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.514541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.514545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.514549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.514553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.514557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.514561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.514565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.514568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.514572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.514576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.514583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.514591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.514597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.514602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.514607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.514612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.514616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.514622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.514626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.514632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.514636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.514646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.514652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.514661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.514665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.514674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.514679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.514688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.514692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.514697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.514706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.514713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.514721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.514726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.514734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.514738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.514746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.514750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.514792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:43.518599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:43.519543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:43.519557Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:43.519559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:43.519563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:43.519570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2622 [2:7556256838817811030:6796]
2025-10-01T14:15:43.519588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:43.519605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:43.519608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.519611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.519614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.519630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:43.519636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:43.519641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:43.519702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.519704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.519706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.519710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:43.519713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:43.519783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:43.519786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.519797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.519809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.519831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:43.519850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732394:2446], now have 1 active actors on pipe
2025-10-01T14:15:43.519853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732589:5915], now have 1 active actors on pipe
2025-10-01T14:15:43.519861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.519863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.519865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.519879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:43.519892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:43.519906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:43.519909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:43.519941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.519944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:43.519999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2622
2025-10-01T14:15:43.520037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2622
2025-10-01T14:15:43.520093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:43.520098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:43.520100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:43.520105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:43.520674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.520683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.520710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:43.520717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.520721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.520724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:43.520734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.520745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:43.520760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.521020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.521026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.521038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.521133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2623 partition: 0 MaxSeqNo: 45 sessionId: src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0
2025-10-01T14:15:43.521517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3f65b-b28f5c70-6c7ab653-30c0ca13_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:43.524230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Write session: try to update token
2025-10-01T14:15:43.524247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:43.537621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId: src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:43.539531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:43.539551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:43.539561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.539607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:43.539729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:43.539917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:43.540494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:43.539773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:43.539910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:43.540029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:43.540150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:43.540318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:43.540357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.540365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.540382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:43.540411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:43.552804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:43.552819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:43.552822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:43.552823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:43.552833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.552837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.552842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256838817811025:6796]
2025-10-01T14:15:43.552891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:43.552897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.552897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:43.552900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:43.552903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:43.552906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:43.553021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:43.590484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256841194732616:5610]
2025-10-01T14:15:43.590775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2622, pipe: [1:7556256841194732616:5610]
2025-10-01T14:15:43.709509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:43.718589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.718607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.718776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.718832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.718891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.718946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.718986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.718991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.719064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.719127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.719190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.719251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.719290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.719293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.719353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.719401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.719452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.719503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.719540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.719543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.719602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.719657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.719708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.719761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.719796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.719799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.719857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.719906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.719957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.720010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.720045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.720048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.720114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.720170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.720230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.720287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.720324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.720327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.720389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.720442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.720501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.720578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.720618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.720621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.720685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.720743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.720801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.720857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.720895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.720897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.720962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.721014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.721070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.721129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.721168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.721171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.721234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.721287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.721344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.721402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.722823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:43.722827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256841194732616:5610]
2025-10-01T14:15:43.722861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:43.722865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:43.722894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2623 reason: error at write: Disconnected sessionId: src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0
2025-10-01T14:15:43.723113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2623 sessionId: src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0 is DEAD
2025-10-01T14:15:43.723203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:43.723211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Write session will restart in 0.009313s
2025-10-01T14:15:43.723238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Write session: Do CDS request
2025-10-01T14:15:43.723246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:43.721878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.721885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.721942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732616:5610], now have 1 active actors on pipe
2025-10-01T14:15:43.723178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:43.734038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.734113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:43.734130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2624
2025-10-01T14:15:43.734279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.734329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:43.734340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:43.734344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:43.734941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2624 sessionId:  describe result for acl check
2025-10-01T14:15:43.734987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:43.734991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:43.734994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:43.735000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256841194732664:5923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:43.735540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256841194732664:5923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:43.741212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256841194732664:5923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:43.745690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:43.745967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256841194732664:5923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:43.745988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256841194732664:5923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:43.745991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256841194732664:5923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:43.746000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:43.748065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:43.748294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:43.748303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:43.748314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:43.748365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:43.748406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256838817811281:6770]
2025-10-01T14:15:43.749037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:43.749336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:43.749380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:43.749697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:43.749757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.749758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.749759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.749760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.749762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.749763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.749764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.749765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.749766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.749767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.749769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.749770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.749771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.749772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.749777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.749788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.749792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.749795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.749799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.749803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.749806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.749810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.749813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.749818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.749820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.749822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.749824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.749826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.749831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.749836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.749842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.749845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.749848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.749871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.749877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.749880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.749883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.749886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.749889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.749892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.749895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.749898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.749901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.749904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.749907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.749910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.749912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.749915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.749918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.749922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.749924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.749927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.749930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.749933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.749935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.749938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.749959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:43.754661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:43.755578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:43.755594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:43.755597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:43.755600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:43.755608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2623 [2:7556256838817811281:6770]
2025-10-01T14:15:43.755624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:43.755647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:43.755654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.755657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.755660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.755679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:43.755688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:43.755695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:43.755759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.755767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.755770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.755773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:43.755775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:43.755845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:43.755851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.755863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.755872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.755887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:43.755917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732830:5923], now have 1 active actors on pipe
2025-10-01T14:15:43.756018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2623
2025-10-01T14:15:43.755921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732626:2446], now have 1 active actors on pipe
2025-10-01T14:15:43.755928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.755930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.755933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.755946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:43.755961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:43.755966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:43.755969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:43.755971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:43.755974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:43.755977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:43.756073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2623
2025-10-01T14:15:43.756013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.756024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:43.756041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:43.756067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.756072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.756093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:43.756100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.756105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.756107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:43.756116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.756125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:43.756142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.756421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.756433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.756454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.756563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2624 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0
2025-10-01T14:15:43.756927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f4a491-2c427df9-b9db715b-97ffa796_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:43.759720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Write session: try to update token
2025-10-01T14:15:43.759738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:43.774023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId: src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:43.773327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:43.773341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:43.773351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.773396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:43.773442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:43.773564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:43.773757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:43.773888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:43.774017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:43.774355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:43.774422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:43.776658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:43.778491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.778515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.778553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:43.778736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:43.792080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:43.792100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:43.792103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:43.792104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:43.792115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.792119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.792124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256838817811275:6770]
2025-10-01T14:15:43.792165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:43.792172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:43.792172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:43.792177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:43.792179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.792181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:43.792314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:43.822903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256841194732842:5610]
2025-10-01T14:15:43.823197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2623, pipe: [1:7556256841194732842:5610]
2025-10-01T14:15:43.945825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:43.953012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.953036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.953179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.953234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.953293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.953349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.953641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.953650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.953719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.953781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.953846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.953912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.953952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.953957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.954022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.954080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.954141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.954199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.954244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.954253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.954321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.954399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.954463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.954524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.954574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.954578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.954637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.954705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.954774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.954842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.954892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.954897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.954972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.955040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.955104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.955171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.955211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.955216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.955281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.955342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.955410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.955474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.955513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.955516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.955586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.955642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.955701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.955762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.955801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.955804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.955873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.955927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.955986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.956043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.956087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.956090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.956156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:43.956209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:43.956266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:43.956326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:43.956367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:43.956368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:43.956496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732842:5610], now have 1 active actors on pipe
2025-10-01T14:15:43.956769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:43.957153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:43.957163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Write session will restart in 0.009889s
2025-10-01T14:15:43.957189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Write session: Do CDS request
2025-10-01T14:15:43.956791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:43.957194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:43.956805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:43.956835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2624 reason: error at write: Disconnected sessionId: src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0
2025-10-01T14:15:43.956927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256841194732842:5610]
2025-10-01T14:15:43.956947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:43.957004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2624 sessionId: src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0 is DEAD
2025-10-01T14:15:43.967892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.967977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:43.967992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2625
2025-10-01T14:15:43.968089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:43.968119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:43.968132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:43.968135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:43.968507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2625 sessionId:  describe result for acl check
2025-10-01T14:15:43.968547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:43.968553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:43.968555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:43.968561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256841194732900:5928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:43.969026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256841194732900:5928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:43.977043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256841194732900:5928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:43.978576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:43.982305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:43.983035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256841194732900:5928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:43.983052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256841194732900:5928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:43.983056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256841194732900:5928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:43.983066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:43.982554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:43.982565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:43.982578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:43.982634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:43.982680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256838817811493:6778]
2025-10-01T14:15:43.983303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:43.983600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:43.983646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:43.983936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:43.984014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.984020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.984021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.984022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.984024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.984025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.984027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.984028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.984030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.984031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.984032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.984033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.984035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.984036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.984041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.984052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.984056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.984060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.984064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.984068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.984071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.984075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.984079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.984084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.984087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.984091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.984095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.984098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.984105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.984113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:43.984123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.984128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:43.984137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.984142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:43.984150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.984155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:43.984163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.984168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:43.984172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.984182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:43.984186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.984195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:43.984200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.984209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:43.984215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.984222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:43.984226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.984231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.984236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.984244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.984248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.984252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.984257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.984262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:43.984270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.984275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:43.984314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:43.988965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:43.989631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:43.989645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:43.989648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:43.989652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:43.989659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2624 [2:7556256838817811493:6778]
2025-10-01T14:15:43.989675Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:43.989693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:43.989696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.989700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.989702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.989719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:43.989725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:43.989733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:43.989803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.989810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.989812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.989816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:43.989818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:43.989883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:43.989892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:43.989904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:43.989915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:43.990055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2624
2025-10-01T14:15:43.990085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2624
2025-10-01T14:15:43.989932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:43.989951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:43.989953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:43.989956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:43.989964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:43.989973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:43.989976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:43.989978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:43.989981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194733053:5928], now have 1 active actors on pipe
2025-10-01T14:15:43.989986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:43.990002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:43.990005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:43.990010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256841194732848:2446], now have 1 active actors on pipe
2025-10-01T14:15:43.990041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:43.990049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:43.990054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:43.991471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.991486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.991517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:43.991531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:43.991536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:43.991539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:43.991550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:43.991566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:43.991591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.991795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:43.991802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:43.991816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:43.991904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2625 partition: 0 MaxSeqNo: 45 sessionId: src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0
2025-10-01T14:15:43.992327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8e304f-b73155d0-3845e967-2f11c8f7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:43.995093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Write session: try to update token
2025-10-01T14:15:43.995113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:44.020613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId: src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:44.022976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:44.023266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.023289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.023326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:44.023447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:44.026100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:44.026116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:44.026119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:44.026121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:44.026130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:44.026134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:44.026138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256838817811487:6778]
2025-10-01T14:15:44.026191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:44.026190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:44.026196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:44.026197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.026199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:44.026201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:44.026345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:44.056957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256845489700362:5610]
2025-10-01T14:15:44.062551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2624, pipe: [1:7556256845489700362:5610]
2025-10-01T14:15:44.195062Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:44.204484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.204510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.204697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.204756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.204819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.204882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.204931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.204936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.205007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.205071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.205132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.205199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.205240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.205243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.205308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.205362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.205421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.205478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.205517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.205520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.205585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.205643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.205704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.205762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.205801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.205804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.205868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.205928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.205984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.206045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.206086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.206090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.206162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.206225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.206287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.206351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.206867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.206874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.206946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.207005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.207068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.207130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.207176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.207179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.207248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.207305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.207367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.207430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.207472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.207475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.207541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.207596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.207661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.207717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.207758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.207761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.207825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.207883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.207940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.207996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.208036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.208038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.208124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700362:5610], now have 1 active actors on pipe
2025-10-01T14:15:44.210552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:44.210598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256845489700362:5610]
2025-10-01T14:15:44.210618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:44.210654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2625 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0
2025-10-01T14:15:44.210846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2625 sessionId: src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0 is DEAD
2025-10-01T14:15:44.209794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:44.211309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:44.211325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Write session will restart in 0.006282s
2025-10-01T14:15:44.211352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Write session: Do CDS request
2025-10-01T14:15:44.211358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:44.222853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:44.223129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:44.223144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2626
2025-10-01T14:15:44.223254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:44.223273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:44.223276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:44.223280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:44.223907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2626 sessionId:  describe result for acl check
2025-10-01T14:15:44.223931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:44.223932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:44.223933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:44.223938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256845489700390:5949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:44.224534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256845489700390:5949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:44.229378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256845489700390:5949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:44.234956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256845489700390:5949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:44.234973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256845489700390:5949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:44.234978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256845489700390:5949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:44.234986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:44.243718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:44.247067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:44.247324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:44.247328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:44.247340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:44.247396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:44.247435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256843112779004:6774]
2025-10-01T14:15:44.248447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:44.249504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:44.249556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:44.249915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:44.249969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.249970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.249972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.249973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.249974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.249975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.249976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.249978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.249979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.249980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.249981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.249982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.249983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.249984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.249990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.250000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.250003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.250007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.250011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.250015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.250018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.250021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.250025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.250029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.250033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.250036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.250039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.250043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.250050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.250059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.250067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.250073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.250077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.250082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.250086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.250091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.250095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.250099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.250103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.250109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.250113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.250118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.250122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.250127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.250131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.250136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.250139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.250145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.250148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.250153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.250159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.250163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.250168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.250173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.250177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.250181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.250219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:44.257913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:44.259016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:44.259029Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:44.259032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:44.259035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:44.259043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2625 [2:7556256843112779004:6774]
2025-10-01T14:15:44.259059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:44.259075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:44.259078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:44.259082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:44.259084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:44.259101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:44.259106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:44.259112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:44.259173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.259180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.259182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.259185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:44.259187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:44.259261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:44.259264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.259275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.259287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.259308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:44.259326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700377:2446], now have 1 active actors on pipe
2025-10-01T14:15:44.259330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700488:5949], now have 1 active actors on pipe
2025-10-01T14:15:44.259338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.259341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.259343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.259357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:44.259370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:44.259389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:44.259392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:44.259426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.259428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:44.259608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2625
2025-10-01T14:15:44.259654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2625
2025-10-01T14:15:44.259694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:44.259704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:44.259706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:44.259712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:44.259809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.259817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.259847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:44.259865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:44.259871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:44.259874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:44.259884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:44.259895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:44.259912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:44.260185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.260197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.260220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:44.260380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2626 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0
2025-10-01T14:15:44.262205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53acd90-e56d97f3-f6c60c13-af429e24_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:44.264899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Write session: try to update token
2025-10-01T14:15:44.264916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:44.284083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId: src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:44.286434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:44.286639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.286662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.286703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:44.286813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:44.307504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:44.307547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:44.307549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:44.307550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:44.307558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.307561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.307563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256843112778998:6774]
2025-10-01T14:15:44.307603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:44.307608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.307609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:44.307628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:44.307641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:44.307645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:44.307722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:44.310813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256845489700611:5610]
2025-10-01T14:15:44.314320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2625, pipe: [1:7556256845489700611:5610]
2025-10-01T14:15:44.474686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:44.475089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700611:5610], now have 1 active actors on pipe
2025-10-01T14:15:44.482773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.482791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.482954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.483012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.483067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.483125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.483163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.483168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.483234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.483286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.483342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.483403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.483440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.483442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.483498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.483549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.483604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.483655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.483691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.483693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.483749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.483804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.483853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.483907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.483942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.483944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.483998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.484044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.484093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.484145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.484179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.484181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.484244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.484298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.484359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.484416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.484456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.484459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.484531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.484588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.484646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.484703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.484742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.484747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.484808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.484863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.484920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.484977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.485015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.485018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.485079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.485130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.485187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.485242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.485279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.485283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.485342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:44.485395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:44.485450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:44.485504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:44.485540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:44.485543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:44.488181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:44.487335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:44.487388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:44.487391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:44.487415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2626 reason: error at write: Disconnected sessionId: src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0
2025-10-01T14:15:44.487599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2626 sessionId: src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0 is DEAD
2025-10-01T14:15:44.487736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256845489700611:5610]
2025-10-01T14:15:44.490585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:44.490597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Write session will restart in 0.007390s
2025-10-01T14:15:44.490620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Write session: Do CDS request
2025-10-01T14:15:44.490626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:44.502886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:44.502936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:44.502950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2627
2025-10-01T14:15:44.503140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:44.503193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:44.503203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:44.503206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:44.503993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2627 sessionId:  describe result for acl check
2025-10-01T14:15:44.504028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:44.504030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:44.504032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:44.504037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256845489700669:5976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:44.504655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256845489700669:5976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:44.507530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256845489700669:5976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:44.512655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256845489700669:5976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:44.512673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256845489700669:5976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:44.512676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256845489700669:5976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:44.512685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:44.512900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:44.515026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:44.515605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:44.515619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:44.515633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:44.515696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:44.515736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256843112779226:6763]
2025-10-01T14:15:44.516290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:44.516604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:44.516645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:44.516948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:44.517000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.517006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.517007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.517008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.517009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.517010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.517011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.517012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.517013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.517014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.517015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.517016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.517017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.517018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.517023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.517032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.517035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.517039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.517043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.517046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.517050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.517054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.517057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.517060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.517063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.517066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.517069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.517072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.517079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.517088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.517094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.517098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.517103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.517107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.517112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.517116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.517121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.517126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.517129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.517133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.517137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.517141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.517145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.517150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.517154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.517158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.517161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.517166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.517182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.517190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.517194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.517198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.517207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.517211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.517215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.517224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.517257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:44.521279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:44.522044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:44.522066Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:44.522070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:44.522075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:44.522082Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2626 [2:7556256843112779226:6763]
2025-10-01T14:15:44.522103Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:44.522123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:44.522126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:44.522130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:44.522132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:44.522148Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:44.522154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:44.522162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:44.522275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.522277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.522279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.522282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:44.522287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:44.522394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:44.522397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.522409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.522419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.522435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:44.522453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.522456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.522459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.522468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:44.522482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:44.522496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:44.522499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:44.522553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.522555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:44.522573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:44.522578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:44.522580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:44.522587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:44.522741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700625:2446], now have 1 active actors on pipe
2025-10-01T14:15:44.522747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700833:5976], now have 1 active actors on pipe
2025-10-01T14:15:44.522925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2626
2025-10-01T14:15:44.522942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2626
2025-10-01T14:15:44.524107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2627 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0
2025-10-01T14:15:44.523410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.523430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.523461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:44.523485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:44.523491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:44.523497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:44.523509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:44.523524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:44.523544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:44.523894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.523901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.523920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:44.526617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3722c67-fd10927e-8b38a6a0-aa5fdd93_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:44.529293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Write session: try to update token
2025-10-01T14:15:44.529310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:44.553086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:44.553110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:44.553113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:44.553115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:44.553125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.553130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.553135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256843112779220:6763]
2025-10-01T14:15:44.553190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:44.553199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.553202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:44.553354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:44.554627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:44.554641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:44.554645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:44.559307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId: src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:44.562258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:44.587842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256845489700849:5610]
2025-10-01T14:15:44.588337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2626, pipe: [1:7556256845489700849:5610]
2025-10-01T14:15:44.783830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:44.783888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256845489700849:5610]
2025-10-01T14:15:44.783905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:44.783912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:44.783969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2627 reason: error at write: Disconnected sessionId: src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0
2025-10-01T14:15:44.784188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2627 sessionId: src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0 is DEAD
2025-10-01T14:15:44.784487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:44.784499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Write session will restart in 0.006275s
2025-10-01T14:15:44.784536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Write session: Do CDS request
2025-10-01T14:15:44.784541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:44.782815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:44.783514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.783524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.783563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700849:5610], now have 1 active actors on pipe
2025-10-01T14:15:44.783996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:44.792637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:44.792982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:44.792994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2628
2025-10-01T14:15:44.793107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:44.793133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:44.793138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:44.793142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:44.793990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2628 sessionId:  describe result for acl check
2025-10-01T14:15:44.794023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:44.794029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:44.794030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:44.794035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256845489700893:5998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:44.794511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256845489700893:5998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:44.800142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256845489700893:5998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:44.804089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256845489700893:5998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:44.804105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256845489700893:5998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:44.804109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256845489700893:5998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:44.804117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:44.806968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:44.809479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:44.809646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:44.809649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:44.809658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:44.809688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:44.809714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256843112779483:6736]
2025-10-01T14:15:44.810108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:44.810448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:44.810477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:44.810677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:44.810707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.810707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.810708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.810709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.810709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.810710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.810711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.810712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.810712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.810713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.810714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.810715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.810715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.810716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.810720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.810726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.810728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.810730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.810732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.810734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.810736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.810739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.810741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.810743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.810745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.810747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.810749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.810751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.810757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.810761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:44.810765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.810768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:44.810771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.810774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:44.810778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.810781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:44.810783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.810786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:44.810789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.810793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:44.810798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.810802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:44.810805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.810810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:44.810816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.810821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:44.810826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.810838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.810841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.810844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.810847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.810849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.810852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.810855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:44.810857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.810860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:44.810880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:44.814545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:44.815403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:44.815407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:44.815408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:44.815411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:44.815416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2627 [2:7556256843112779483:6736]
2025-10-01T14:15:44.815429Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:44.815442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:44.815445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:44.815448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:44.815450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:44.815465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:44.815469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:44.815473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:44.815515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.815516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.815517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.815520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:44.815522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:44.815583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:44.815586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.815596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:44.815604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:44.815618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:44.815634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.815636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.815638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.815645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:44.815650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:44.815652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:44.815653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:44.815657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:44.815669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:44.815672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:44.815680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489701051:5998], now have 1 active actors on pipe
2025-10-01T14:15:44.815683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489700860:2446], now have 1 active actors on pipe
2025-10-01T14:15:44.815707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.815713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:44.815931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2627
2025-10-01T14:15:44.815964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2627
2025-10-01T14:15:44.815891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:44.816131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.816138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.816163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:44.816171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:44.816174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:44.816177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:44.816185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:44.816193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:44.816206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:44.817801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2628 partition: 0 MaxSeqNo: 45 sessionId: src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0
2025-10-01T14:15:44.818233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a1c77f-3168624c-fdd5cf3b-6fe4e478_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:44.817445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.817456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.817475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:44.820956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Write session: try to update token
2025-10-01T14:15:44.820971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:44.860666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId: src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:44.863556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:44.866569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:44.866590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:44.866629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:44.867911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:44.883676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256845489701077:5610]
2025-10-01T14:15:44.886326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:44.886341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:44.886343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:44.886345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:44.886354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.886359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.886362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256843112779478:6736]
2025-10-01T14:15:44.886419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:44.886425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:44.886427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:44.886560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:44.888448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:44.888453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:44.888457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:44.894590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2627, pipe: [1:7556256845489701077:5610]
2025-10-01T14:15:45.131116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:45.131592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256845489701077:5610], now have 1 active actors on pipe
2025-10-01T14:15:45.172084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.172109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.172295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.172363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.172432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.172493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.172696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.172702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.172777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.172836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.172900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.172968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.173016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.173019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.173098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.173153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.173217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.173277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.173318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.173321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.173390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.173457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.182518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.182593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.182634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.182640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.182725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.182783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.182843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.182900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.182944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.182947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.183027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.183098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.183161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.183224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.183270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.183273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.183348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.183408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.183492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.183550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.183605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.183608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.183680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.183738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.183807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.183868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.183913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.183917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.183989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.184050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.184114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.184179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.184223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.184229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.184301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.184359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.184421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.184486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.184546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.184549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.188138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:45.188151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Write session will restart in 0.005310s
2025-10-01T14:15:45.188178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Write session: Do CDS request
2025-10-01T14:15:45.188184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:45.187297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256845489701077:5610]
2025-10-01T14:15:45.187332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:45.187334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:45.187360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2628 reason: error at write: Disconnected sessionId: src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0
2025-10-01T14:15:45.187557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2628 sessionId: src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0 is DEAD
2025-10-01T14:15:45.187688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:45.190097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:45.194907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:45.195303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:45.195318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2629
2025-10-01T14:15:45.195876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:45.195911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:45.195917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:45.195921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:45.196715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2629 sessionId:  describe result for acl check
2025-10-01T14:15:45.196748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:45.196750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:45.196754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:45.196759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256849784668414:6008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:45.197278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256849784668414:6008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:45.203649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256849784668414:6008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:45.208232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256849784668414:6008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:45.208248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256849784668414:6008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:45.208251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256849784668414:6008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:45.208259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:45.226305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:45.238682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:45.238977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:45.238981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:45.238995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:45.239053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:45.239105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256847407747001:6734]
2025-10-01T14:15:45.239708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:45.240213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:45.240258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:45.240595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:45.240658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.240660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.240661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.240662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.240663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.240665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.240666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.240668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.240669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.240671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.240673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.240676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.240677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.240678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.240683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.240693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.240697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.240702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.240705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.240709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.240713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.240717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.240721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.240724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.240728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.240731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.240736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.240739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.240749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.240756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.240764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.240770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.240774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.240780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.240786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.240792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.240796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.240802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.240808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.240813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.240818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.240823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.240828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.240832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.240838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.240844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.240850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.240855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.240862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.240873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.240877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.240884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.240890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.240895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.240899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.240904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.240954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:45.246154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:45.246833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:45.246839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:45.246845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:45.246849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:45.246857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2628 [2:7556256847407747001:6734]
2025-10-01T14:15:45.246887Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:45.246906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:45.246910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:45.246914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:45.246923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:45.246938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:45.246944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:45.246950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:45.247010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.247013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.247015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.247019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:45.247021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:45.247095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:45.247098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.247109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.247120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.247135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:45.247152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.247155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.247157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.247170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:45.247184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:45.247203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:45.247206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:45.247246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.247249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:45.247476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:45.247482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:45.247484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:45.247490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:45.248222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2628
2025-10-01T14:15:45.248260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2628
2025-10-01T14:15:45.251999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668495:6008], now have 1 active actors on pipe
2025-10-01T14:15:45.252020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668401:2446], now have 1 active actors on pipe
2025-10-01T14:15:45.252042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.252050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.252086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:45.252096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:45.252102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:45.252104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:45.252117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:45.252133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:45.252154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:45.252512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.252534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.252551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:45.252686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2629 partition: 0 MaxSeqNo: 45 sessionId: src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0
2025-10-01T14:15:45.253324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2479d1-d851f747-b69d156d-2ddf21a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:45.269320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Write session: try to update token
2025-10-01T14:15:45.269346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:45.287737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256849784668628:5610]
2025-10-01T14:15:45.288177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2628, pipe: [1:7556256849784668628:5610]
2025-10-01T14:15:45.287712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:45.287730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:45.287737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:45.287739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:45.287752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.287757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.287763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256847407746995:6734]
2025-10-01T14:15:45.287813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:45.287820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.287822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:45.288025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:45.288030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:45.288036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:45.288244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:45.300829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId: src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:45.303477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:45.453153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:45.453974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668628:5610], now have 1 active actors on pipe
2025-10-01T14:15:45.454032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.454039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.456248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256849784668628:5610]
2025-10-01T14:15:45.456283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:45.456285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:45.456354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2629 reason: error at write: Disconnected sessionId: src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0
2025-10-01T14:15:45.456547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2629 sessionId: src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0 is DEAD
2025-10-01T14:15:45.456683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:45.457029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:45.457035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Write session will restart in 0.008048s
2025-10-01T14:15:45.457056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Write session: Do CDS request
2025-10-01T14:15:45.457063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:45.456208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:45.470944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:45.471287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:45.471302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2630
2025-10-01T14:15:45.471441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:45.471470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:45.471475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:45.471478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:45.471869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2630 sessionId:  describe result for acl check
2025-10-01T14:15:45.471896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:45.471898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:45.471899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:45.471905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256849784668672:6025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:45.472406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256849784668672:6025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:45.474620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256849784668672:6025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:45.484646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256849784668672:6025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:45.484662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256849784668672:6025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:45.484665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256849784668672:6025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:45.484674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:45.499736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:45.504945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:45.505170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:45.505175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:45.505186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:45.505230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:45.505275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256847407747226:6718]
2025-10-01T14:15:45.505859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:45.506689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:45.506737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:45.507041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:45.507090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.507091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.507092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.507093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.507094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.507095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.507096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.507097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.507098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.507099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.507100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.507101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.507102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.507103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.507108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.507116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.507119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.507122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.507125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.507129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.507132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.507135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.507138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.507141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.507144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.507148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.507151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.507154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.507162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.507169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:45.507174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.507179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:45.507183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.507187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:45.507190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.507194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:45.507198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.507203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:45.507207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.507212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:45.507215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.507219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:45.507222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.507226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:45.507230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.507234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:45.507238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.507242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.507245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.507249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.507253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.507256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.507260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.507265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:45.507268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.507272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:45.507305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:45.516612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:45.518148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:45.518156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:45.518160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:45.518164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:45.518174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2629 [2:7556256847407747226:6718]
2025-10-01T14:15:45.518203Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:45.518233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:45.518238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:45.518243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:45.518245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:45.518271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:45.518280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:45.518288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:45.518411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.518413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.518415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.518421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:45.518424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:45.518496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:45.518498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.518512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:45.518522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:45.518537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:45.518557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.518560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.518563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.518581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:45.518605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:45.518621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:45.518627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:45.518689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.518693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:45.520459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2629
2025-10-01T14:15:45.520527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2629
2025-10-01T14:15:45.519131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:45.519142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:45.519145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:45.519155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:45.520655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668658:2446], now have 1 active actors on pipe
2025-10-01T14:15:45.520664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668767:6025], now have 1 active actors on pipe
2025-10-01T14:15:45.521012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.521027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.521062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde1afbf-debd087c-1fb9d925-800751e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:45.521072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:45.521080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:45.521083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:45.521105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:45.521120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:45.521141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:45.521566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.521573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.521589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:45.521779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2630 partition: 0 MaxSeqNo: 45 sessionId: src_id|bde1afbf-debd087c-1fb9d925-800751e0_0
2025-10-01T14:15:45.526828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa1b93-a7c8d00e-f893f19a-e76db840_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bde1afbf-debd087c-1fb9d925-800751e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:45.529893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Write session: try to update token
2025-10-01T14:15:45.529915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:45.556266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256849784668881:5610]
2025-10-01T14:15:45.556682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668881:5610], now have 1 active actors on pipe
2025-10-01T14:15:45.556807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2629, pipe: [1:7556256849784668881:5610]
2025-10-01T14:15:45.562100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId: src_id|bde1afbf-debd087c-1fb9d925-800751e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:45.564626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:45.566888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.566907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.569147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:45.569176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:45.569179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:45.569182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:45.569184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:45.569194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.569199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.569203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256847407747220:6718]
2025-10-01T14:15:45.569247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:45.569256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:45.569258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:45.569404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:45.572915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:45.572927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:45.572931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:45.573045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:45.905177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:45.967131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:45.967160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:45.967368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.967445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.967523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.967600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.968258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.968266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.968354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.968429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.968562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.968642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.968690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.968697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.968775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.968847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.968928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.969004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.969051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.969054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.969133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.969208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.969279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.969352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.969399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.969402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.969479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.969552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.969628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.969699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.969747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.969750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.969849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.969925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.970006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.970084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.970132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.970135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.970217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.970290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.986454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.986558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.986628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.986633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.986726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.986795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.986865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.986943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.986992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.986995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.987074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.987142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.987221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.987296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.987348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.987352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.987437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:45.987500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:45.987567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:45.987633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:45.987676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:45.987679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:45.992169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:45.992197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:45.992231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2630 reason: error at write: Disconnected sessionId: src_id|bde1afbf-debd087c-1fb9d925-800751e0_0
2025-10-01T14:15:45.992420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2630 sessionId: src_id|bde1afbf-debd087c-1fb9d925-800751e0_0 is DEAD
2025-10-01T14:15:45.992596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256849784668881:5610]
2025-10-01T14:15:45.992611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:45.994792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:45.994804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Write session will restart in 0.005107s
2025-10-01T14:15:45.994830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Write session: Do CDS request
2025-10-01T14:15:45.994836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:45.994613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:46.001371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.001742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:46.001758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2631
2025-10-01T14:15:46.001930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.001962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:46.001967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:46.001971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:46.002347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2631 sessionId:  describe result for acl check
2025-10-01T14:15:46.002393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:46.002394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:46.002395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:46.002400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256849784668912:6033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:46.002893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256849784668912:6033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:46.008445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256849784668912:6033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:46.019460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256849784668912:6033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:46.019479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256849784668912:6033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:46.019483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256849784668912:6033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:46.019491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:46.040815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:46.047024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:46.047310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:46.047314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:46.047325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:46.047372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:46.047416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256851702714791:6695]
2025-10-01T14:15:46.048073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:46.050303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:46.050359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:46.050718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:46.050762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.050763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.050764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.050766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.050767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.050769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.050770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.050772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.050773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.050774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.050775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.050776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.050777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.050779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.050785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.050796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.050799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.050804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.050807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.050812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.050815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.050818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.050822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.050827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.050830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.050834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.050837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.050840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.050848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.050856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.050862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.050867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.050875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.050880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.050884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.050889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.050893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.050898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.050903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.050908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.050913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.050918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.050922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.050927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.050931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.050937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.050942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.050946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.050951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.050958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.050963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.050968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.050973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.050978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.050983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.050987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.051027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:46.063205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:46.063969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:46.063984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:46.063987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:46.063991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:46.063999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2630 [2:7556256851702714791:6695]
2025-10-01T14:15:46.064016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:46.064035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:46.064038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.064043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.064045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.064063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:46.064069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:46.064076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:46.064142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.064144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.064146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.064150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:46.064153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:46.064229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:46.064232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.064244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.064254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.064271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:46.064288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.064290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.064293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.064309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:46.064325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:46.064341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:46.064344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:46.064376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:46.064379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:46.064382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:46.064386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.064389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:46.064450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:46.064735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2630
2025-10-01T14:15:46.064777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2630
2025-10-01T14:15:46.065181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636274:6033], now have 1 active actors on pipe
2025-10-01T14:15:46.065192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256849784668900:2446], now have 1 active actors on pipe
2025-10-01T14:15:46.065206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.065212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.065240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:46.065248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.065253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.065255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:46.065265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.065276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:46.065293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.065761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.065774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.065797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.065937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2631 partition: 0 MaxSeqNo: 45 sessionId: src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0
2025-10-01T14:15:46.066416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1afbf-debd087c-1fb9d925-800751e0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:46.068858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Write session: try to update token
2025-10-01T14:15:46.068873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:46.083458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:46.083480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:46.083489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.083536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:46.083556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:46.083698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:46.083835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:46.083974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:46.084103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:46.084280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:46.084317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:46.092620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256854079636420:5610]
2025-10-01T14:15:46.093917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636420:5610], now have 1 active actors on pipe
2025-10-01T14:15:46.093124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2630, pipe: [1:7556256854079636420:5610]
2025-10-01T14:15:46.093136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId: src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:46.095623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:46.096005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.096022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.096057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:46.096162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:46.127034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.127301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.127481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.127538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.127600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.127657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.127706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.127710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.127776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.127831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.127888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.127951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.127990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.127993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.128056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.128117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.128194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.128254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.128294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.128297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.128361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.128421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.128479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.128559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.128600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.128602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.128674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.128733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.128793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.129156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.129203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.129206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.129279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.129338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.129399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.129460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.129503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.129505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.129575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.129633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.129697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.129759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.129817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.129820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.129888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.129945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.130003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.130067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.130127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.130129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.130215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.130271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.130330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.130408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.130454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.130456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.130528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.130586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.130647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.130709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.130756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.130759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.130857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:15:46.130926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.130945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.130948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:15:46.130967Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.130977Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.130982Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.130986Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.130989Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.130994Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.130999Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131003Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131007Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131011Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131215Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131220Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131226Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131229Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131232Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131642Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131646Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131650Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131654Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131656Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131660Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131663Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131666Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131669Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131672Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131890Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131893Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131897Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131901Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131904Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131907Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131912Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.131915Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.132287Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.132300Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:46.132442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:15:46.132458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:15:46.132461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:15:46.132464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:15:46.132467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:15:46.132897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:15:46.132910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:15:46.132917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:15:46.132920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:15:46.132922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:15:46.132926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:15:46.133544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:15:46.133557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:15:46.133562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:15:46.133566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:15:46.133569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:15:46.133574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:15:46.134112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:15:46.134123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.134230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759328146133
2025-10-01T14:15:46.144109Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:15:46.144143Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:15:46.144158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:46.144166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:46.144169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:46.144171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:46.144181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.144188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.144191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256851702714783:6695]
2025-10-01T14:15:46.144236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:46.144248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:46.144260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:46.144287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:46.144298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.144300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:46.144441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:46.334019Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:46.334814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256854079636420:5610]
2025-10-01T14:15:46.334855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:46.334858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:46.334884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2631 reason: error at write: Disconnected sessionId: src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0
2025-10-01T14:15:46.335065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2631 sessionId: src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0 is DEAD
2025-10-01T14:15:46.335248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:46.335486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:46.336383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:46.336392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Write session will restart in 0.008744s
2025-10-01T14:15:46.336417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Write session: Do CDS request
2025-10-01T14:15:46.336422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:46.345906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.347050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:46.347068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2632
2025-10-01T14:15:46.347597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.347633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:46.347643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:46.347647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:46.348064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2632 sessionId:  describe result for acl check
2025-10-01T14:15:46.348101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:46.348102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:46.348104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:46.348109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256854079636447:6039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:46.348604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256854079636447:6039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:46.355503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256854079636447:6039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:46.364751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256854079636447:6039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:46.364771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256854079636447:6039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:46.364775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256854079636447:6039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:46.364784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:46.377731Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ae7581f809b1c1f7] Result# TEvPutResult {Id# [72075186224037892:2630:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:15:46.403062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:46.405899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:46.406235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:46.406240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:46.406256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:46.406321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:46.406361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256851702715015:6686]
2025-10-01T14:15:46.407159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:46.407546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:46.407601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:46.407878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:46.407926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.407932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.407932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.407933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.407934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.407934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.407935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.407936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.407937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.407938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.407938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.407939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.407939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.407944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.407950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.407953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.407955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.407958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.407960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.407963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.407965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.407968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.407970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.407972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.407975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.407977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.407979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.407985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.407991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.407995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.407999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.408002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.408005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.408010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.408015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.408019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.408024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.408029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.408033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.408039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.408044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.408048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.408052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.408055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.408059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.408061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.408064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.408067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.408070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.408073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.408076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.408079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.408082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.408085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.408088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.408111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:46.413424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:46.414210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:46.414226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:46.414229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:46.414234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:46.414255Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2631 [2:7556256851702715015:6686]
2025-10-01T14:15:46.414278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:46.414304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:46.414313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.414317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.414320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.414338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:46.414350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:46.414357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:46.414448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.414456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.414460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.414464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:46.414467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:46.414550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:46.414560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.414573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.414586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.414606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:46.414626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.414629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.414632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.414646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:46.414653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:46.414656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:46.414658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:46.414663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636481:6039], now have 1 active actors on pipe
2025-10-01T14:15:46.414670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636439:2446], now have 1 active actors on pipe
2025-10-01T14:15:46.414681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:46.414695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:46.414698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:46.414736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.414744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:46.415063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:46.415564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.415572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.415607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:46.415616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.415623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.415625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:46.415638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.415651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:46.415671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.416198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.416209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.416227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.416806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56cf7b9d-42225d28-11e0df52-266ba13f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:46.414990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2631
2025-10-01T14:15:46.415026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2631
2025-10-01T14:15:46.416349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2632 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0
2025-10-01T14:15:46.419777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Write session: try to update token
2025-10-01T14:15:46.419798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:46.442259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636665:5610], now have 1 active actors on pipe
2025-10-01T14:15:46.439272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256854079636665:5610]
2025-10-01T14:15:46.440126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2631, pipe: [1:7556256854079636665:5610]
2025-10-01T14:15:46.444736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:46.444755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:46.444762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:46.444764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:46.444773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.444779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.444784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256851702715010:6686]
2025-10-01T14:15:46.444837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:46.444839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:46.444847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:46.444847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.444850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:46.444851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:46.445010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:46.456552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId: src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:46.460256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:46.617062Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:46.617447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.617457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.618510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:46.618525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:46.618553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:46.618588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2632 reason: error at write: Disconnected sessionId: src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0
2025-10-01T14:15:46.618593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256854079636665:5610]
2025-10-01T14:15:46.618806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2632 sessionId: src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0 is DEAD
2025-10-01T14:15:46.619107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:46.619119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Write session will restart in 0.006920s
2025-10-01T14:15:46.619146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Write session: Do CDS request
2025-10-01T14:15:46.619153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:46.618908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:46.631284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.631572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:46.631590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2633
2025-10-01T14:15:46.631703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.631730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:46.631736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:46.631740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:46.632238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2633 sessionId:  describe result for acl check
2025-10-01T14:15:46.632279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:46.632285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:46.632288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:46.632294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256854079636726:6076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:46.632912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256854079636726:6076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:46.648363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256854079636726:6076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:46.652450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256854079636726:6076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:46.652469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256854079636726:6076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:46.652481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256854079636726:6076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:46.652488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:46.665429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:46.668440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:46.668715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:46.668724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:46.668735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:46.668789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:46.668831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256851702715242:6677]
2025-10-01T14:15:46.669433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:46.669684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:46.669722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:46.670027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:46.670079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.670084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.670085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.670087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.670089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.670090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.670091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.670092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.670093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.670095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.670096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.670097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.670099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.670100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.670105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.670115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.670119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.670123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.670127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.670131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.670135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.670139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.670143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.670149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.670153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.670156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.670170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.670173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.670180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.670193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.670204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.670214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.670219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.670229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.670233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.670242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.670253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.670258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.670265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.670271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.670280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.670285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.670293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.670298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.670308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.670317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.670321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.670330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.670335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.670343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.670348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.670357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.670363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.670385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.670394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.670399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.670442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:46.674362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:46.675549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:46.675563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:46.675565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:46.675569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:46.675576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2632 [2:7556256851702715242:6677]
2025-10-01T14:15:46.675591Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:46.675607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:46.675610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.675613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.675616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.675630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:46.675642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:46.675647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:46.675710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.675716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.675718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.675721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:46.675723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:46.675784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:46.675790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.676225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2632
2025-10-01T14:15:46.676263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2632
2025-10-01T14:15:46.675801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.675815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.675828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:46.675846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636699:2446], now have 1 active actors on pipe
2025-10-01T14:15:46.675850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636806:6076], now have 1 active actors on pipe
2025-10-01T14:15:46.675856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.675859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.675861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.675874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:46.675884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:46.675886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:46.675889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:46.675891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:46.675899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:46.675902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:46.675929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.675935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:46.675940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:46.676500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.676511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.676546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:46.676559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.676563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.676566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:46.676575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.676584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:46.676597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.676841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.676853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.676876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.676970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2633 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0
2025-10-01T14:15:46.677323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab9f069-cd1bac35-3917b568-48a468a3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:46.679924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Write session: try to update token
2025-10-01T14:15:46.679943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:46.690844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:46.690861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:46.690876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.690918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:46.691094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:46.691231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:46.691361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:46.691494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:46.691674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:46.691709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:46.691858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:46.700560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId: src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:46.703001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:46.706489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.706507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.706545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:46.713378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:46.713395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:46.713397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:46.713399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:46.713409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.713413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.713416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256851702715237:6677]
2025-10-01T14:15:46.713460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:46.713458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:46.713464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:46.713466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.713468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:46.713471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:46.713595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:46.708011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:46.718827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256854079636931:5610]
2025-10-01T14:15:46.719059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2632, pipe: [1:7556256854079636931:5610]
2025-10-01T14:15:46.867272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:46.867620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636931:5610], now have 1 active actors on pipe
2025-10-01T14:15:46.875331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.875357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.875523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.875581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.875645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.875707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.875896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.875906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.875972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.876030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.876090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.876154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.876195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.876206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.876273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.876368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.876430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.876493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.876549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.876556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.876619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.876685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.876746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.876808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.876856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.876861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.876925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.876982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.877043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.877102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.877141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.877148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.877207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.877260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.877315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.877371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.877416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.877422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.877484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.877536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.877593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.877648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.877692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.877698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.877754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.877808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.877862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.877919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.877960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.877966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.878024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.878076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.878133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.878188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.878228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.878233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.878290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:46.878345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:46.878424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:46.878485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:46.878527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:46.878533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:46.879142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:46.879156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:46.879184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2633 reason: error at write: Disconnected sessionId: src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0
2025-10-01T14:15:46.879376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2633 sessionId: src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0 is DEAD
2025-10-01T14:15:46.879510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256854079636931:5610]
2025-10-01T14:15:46.879526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:46.879816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:46.879829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Write session will restart in 0.007426s
2025-10-01T14:15:46.879855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Write session: Do CDS request
2025-10-01T14:15:46.879862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:46.879613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:46.889581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.890001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:46.890017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2634
2025-10-01T14:15:46.890151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:46.890183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:46.890188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:46.890192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:46.890556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2634 sessionId:  describe result for acl check
2025-10-01T14:15:46.890589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:46.890591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:46.890592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:46.890597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256854079636952:6074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:46.891083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256854079636952:6074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:46.895913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256854079636952:6074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:46.900194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256854079636952:6074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:46.900210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256854079636952:6074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:46.900214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256854079636952:6074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:46.900223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:46.927078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:46.930355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:46.930740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:46.930750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:46.930765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:46.930839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:46.930876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256851702715507:6659]
2025-10-01T14:15:46.931451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:46.931768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:46.931821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:46.932229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:46.932302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.932307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.932309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.932310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.932311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.932312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.932313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.932315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.932316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.932317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.932318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.932320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.932321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.932322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.932329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.932340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.932344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.932350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.932353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.932357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.932361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.932364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.932369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.932379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.932383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.932387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.932390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.932394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.932402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.932414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:46.932420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.932427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:46.932431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.932437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:46.932442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.932452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:46.932461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.932468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:46.932475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.932481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:46.932499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.932506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:46.932509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.932513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:46.932526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.932530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:46.932534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.932538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.932545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.932549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.932553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.932558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.932563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.932569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:46.932573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.932579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:46.932620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:46.943572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:46.944173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:46.944188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:46.944191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:46.944196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:46.944204Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2633 [2:7556256851702715507:6659]
2025-10-01T14:15:46.944222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:46.944241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:46.944244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.944248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.944252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.944271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:46.944277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:46.944284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:46.944351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.944353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.944356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.944359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:46.944363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:46.944432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:46.944435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.944446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:46.944456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:46.944471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:46.944488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.944490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.944493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.944511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:46.944536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:46.944550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:46.944553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:46.944560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:46.944564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:46.944567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:46.944593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.944596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:46.944642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:46.944821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079636937:2446], now have 1 active actors on pipe
2025-10-01T14:15:46.944829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079637043:6074], now have 1 active actors on pipe
2025-10-01T14:15:46.945352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2633
2025-10-01T14:15:46.945391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2633
2025-10-01T14:15:46.945469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.945486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.945516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:46.945529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:46.945533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:46.945536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:46.945546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:46.945557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:46.945573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.946959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:46.946970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:46.946994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:46.947212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2634 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0
2025-10-01T14:15:46.947612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc96408-6ceb8333-267ec05f-88cff0a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:46.950138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Write session: try to update token
2025-10-01T14:15:46.950156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:46.968978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:46.968996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:46.969000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:46.969002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:46.969013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.969022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.969026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256851702715501:6659]
2025-10-01T14:15:46.969076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:46.969083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:46.969086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:46.969235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:46.970798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:46.970810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:46.970817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:46.973827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId: src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:46.976312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:46.979349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256854079637162:5610]
2025-10-01T14:15:46.979582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2633, pipe: [1:7556256854079637162:5610]
2025-10-01T14:15:47.124471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:47.125236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.125252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.125277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256854079637162:5610], now have 1 active actors on pipe
2025-10-01T14:15:47.125510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:47.125976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:47.126034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256854079637162:5610]
2025-10-01T14:15:47.126486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:47.126497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Write session will restart in 0.008433s
2025-10-01T14:15:47.126522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Write session: Do CDS request
2025-10-01T14:15:47.126528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:47.126058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:47.126128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0
2025-10-01T14:15:47.126326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2634 sessionId: src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0 is DEAD
2025-10-01T14:15:47.135873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.137459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:47.137477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2635
2025-10-01T14:15:47.137624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.137660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:47.137665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:47.137669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:47.138098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2635 sessionId:  describe result for acl check
2025-10-01T14:15:47.138135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:47.138141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:47.138143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:47.138149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256858374604488:6091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:47.138698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256858374604488:6091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:47.140493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256858374604488:6091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:47.146504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256858374604488:6091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:47.146521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256858374604488:6091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:47.146524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256858374604488:6091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:47.146536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:47.151600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:47.157202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:47.157429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:47.157442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:47.157452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:47.157498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:47.157531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256855997683024:6660]
2025-10-01T14:15:47.158243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:47.158576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:47.158623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:47.158934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:47.158988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.158994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.158995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.158996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.158998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.158999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.159000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.159002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.159003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.159005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.159006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.159007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.159008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.159009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.159015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.159024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.159028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.159032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.159035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.159039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.159042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.159046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.159050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.159055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.159058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.159062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.159066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.159070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.159076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.159083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.159089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.159094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.159098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.159103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.159107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.159112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.159116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.159121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.159126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.159130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.159135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.159141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.159144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.159149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.159154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.159159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.159165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.159169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.159174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.159179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.159189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.159195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.159200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.159206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.159210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.159215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.159257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:47.167527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:47.168144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:47.168160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:47.168163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:47.168167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:47.168174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2634 [2:7556256855997683024:6660]
2025-10-01T14:15:47.168193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:47.168211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:47.168219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.168222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.168225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.168242Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:47.168252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:47.168258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:47.168327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.168333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.168336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.168339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:47.168343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:47.168412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:47.168419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.168431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.168440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.168455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:47.168483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604463:2446], now have 1 active actors on pipe
2025-10-01T14:15:47.168486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604624:6091], now have 1 active actors on pipe
2025-10-01T14:15:47.168495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.168501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.168504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.168529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:47.168548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:47.168566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:47.168574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:47.168599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:47.168606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:47.168608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:47.168612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.168615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:47.168637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:47.168709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.168717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.168747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:47.168756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.168760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.168762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:47.168773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.168784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:47.168805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.168952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.168961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.168976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.169424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb860d10-83d09fa8-7a53815-a12ccbbd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:47.168577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2634
2025-10-01T14:15:47.168585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2634
2025-10-01T14:15:47.169074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2635 partition: 0 MaxSeqNo: 45 sessionId: src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0
2025-10-01T14:15:47.171966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Write session: try to update token
2025-10-01T14:15:47.171985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:47.193017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:47.193040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:47.193042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:47.193044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:47.193055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.193060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.193065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256855997683018:6660]
2025-10-01T14:15:47.193116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:47.193123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.193126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:47.193265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:47.196768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:47.196781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:47.196785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:47.197947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId: src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:47.200826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:47.226097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256858374604707:5610]
2025-10-01T14:15:47.226394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2634, pipe: [1:7556256858374604707:5610]
2025-10-01T14:15:47.351977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:47.352709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.352722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.352772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604707:5610], now have 1 active actors on pipe
2025-10-01T14:15:47.353161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:47.354682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256858374604707:5610]
2025-10-01T14:15:47.354720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:47.354754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:47.354826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2635 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0
2025-10-01T14:15:47.355002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2635 sessionId: src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0 is DEAD
2025-10-01T14:15:47.355307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:47.355320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Write session will restart in 0.006644s
2025-10-01T14:15:47.355349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Write session: Do CDS request
2025-10-01T14:15:47.355355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:47.362905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.363294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:47.363311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2636
2025-10-01T14:15:47.363483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.363515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:47.363519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:47.363522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:47.363887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2636 sessionId:  describe result for acl check
2025-10-01T14:15:47.363909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:47.363910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:47.363911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:47.363915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256858374604717:6101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:47.364445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256858374604717:6101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:47.367473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256858374604717:6101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:47.375036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256858374604717:6101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:47.375054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256858374604717:6101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:47.375057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256858374604717:6101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:47.375065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:47.405083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:47.407760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:47.408001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:47.408011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:47.408022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:47.408073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:47.408111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256855997683250:6652]
2025-10-01T14:15:47.408803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:47.409272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:47.409326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:47.409636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:47.409699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.409700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.409701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.409702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.409704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.409705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.409706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.409707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.409708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.409709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.409711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.409712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.409713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.409714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.409720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.409730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.409735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.409738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.409742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.409745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.409749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.409753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.409756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.409760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.409764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.409767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.409770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.409774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.409783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.409790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.409796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.409802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.409806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.409811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.409816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.409821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.409825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.409829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.409833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.409838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.409842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.409847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.409850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.409854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.409858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.409863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.409867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.409872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.409876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.409881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.409885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.409889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.409894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.409899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.409905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.409910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.409946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:47.422861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:47.424019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:47.424029Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:47.424032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:47.424035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:47.424042Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2635 [2:7556256855997683250:6652]
2025-10-01T14:15:47.424059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:47.424078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:47.424081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.424085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.424089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.424104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:47.424113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:47.424120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:47.424171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.424178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.424180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.424184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:47.424187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:47.424263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:47.424269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.424282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.424298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.424319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:47.424339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.424344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.424346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.424361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:47.424378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:47.424396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:47.424402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:47.424435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.424441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:47.424817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:47.424823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:47.424825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:47.424827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604759:6101], now have 1 active actors on pipe
2025-10-01T14:15:47.424830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:47.425014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604710:2446], now have 1 active actors on pipe
2025-10-01T14:15:47.428300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2635
2025-10-01T14:15:47.428335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2635
2025-10-01T14:15:47.428424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.428438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.428468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6485e088-40bd9eb8-afa6025c-beff0476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:47.428478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.428486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.428489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:47.428502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.428527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:47.428549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.430173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.430193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.430233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.434271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2636 partition: 0 MaxSeqNo: 45 sessionId: src_id|6485e088-40bd9eb8-afa6025c-beff0476_0
2025-10-01T14:15:47.437469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af1f966-eaf1869c-5677a8a6-76892f1b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6485e088-40bd9eb8-afa6025c-beff0476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:47.440223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Write session: try to update token
2025-10-01T14:15:47.440246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:47.457306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256858374604939:5610]
2025-10-01T14:15:47.457341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId: src_id|6485e088-40bd9eb8-afa6025c-beff0476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:47.459040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604939:5610], now have 1 active actors on pipe
2025-10-01T14:15:47.459737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2635, pipe: [1:7556256858374604939:5610]
2025-10-01T14:15:47.459801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:47.459975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.459991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.460030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:47.460569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:47.463331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:47.463347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:47.463350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:47.463352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:47.463362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.463367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.463375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256855997683245:6652]
2025-10-01T14:15:47.463424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:47.463435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.463437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:47.463574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:47.466554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:47.466567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:47.466572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:47.621401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:47.629957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.629982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.630160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.630229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.630298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.630385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.630438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.630442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.630520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.630585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.630654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.630728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.630775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.630779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.630851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.630913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.630977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.631039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.631083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.631088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.631154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.631222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.631284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.631361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.631403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.631410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.631473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.631529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.631587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.631651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.631694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.631700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.631765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.631826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.631892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.631957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.632002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.632009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.632095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.632162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.632229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.632296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.632342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.632351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.632420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.632484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.632562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.632629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.632674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.632681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.632753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.632818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.632887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.632955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.633006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.633009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.633079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:47.633136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:47.633195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:47.633257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:47.633296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:47.633299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:47.634946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:47.635023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:47.635081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256858374604939:5610]
2025-10-01T14:15:47.635103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:47.635105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:47.635129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2636 reason: error at write: Disconnected sessionId: src_id|6485e088-40bd9eb8-afa6025c-beff0476_0
2025-10-01T14:15:47.635491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2636 sessionId: src_id|6485e088-40bd9eb8-afa6025c-beff0476_0 is DEAD
2025-10-01T14:15:47.635508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:47.635520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Write session will restart in 0.009815s
2025-10-01T14:15:47.635546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Write session: Do CDS request
2025-10-01T14:15:47.635552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:47.647217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.648530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:47.648545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2637
2025-10-01T14:15:47.648707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.648740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:47.648746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:47.648749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:47.650581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2637 sessionId:  describe result for acl check
2025-10-01T14:15:47.650616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:47.650618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:47.650619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:47.650625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256858374604995:6121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:47.651118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256858374604995:6121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:47.660103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256858374604995:6121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:47.669818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:47.671023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256858374604995:6121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:47.671039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256858374604995:6121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:47.671042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256858374604995:6121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:47.671052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:47.672426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:47.672656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:47.672661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:47.672674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:47.672727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:47.672762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256855997683480:6639]
2025-10-01T14:15:47.673356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:47.673723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:47.673764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:47.674052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:47.674114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.674115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.674116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.674117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.674118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.674120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.674121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.674122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.674123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.674124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.674125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.674126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.674127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.674129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.674134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.674145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.674149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.674153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.674156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.674160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.674164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.674167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.674171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.674175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.674178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.674182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.674185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.674188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.674194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.674201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.674206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.674211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.674215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.674220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.674224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.674228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.674232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.674237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.674241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.674246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.674251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.674255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.674259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.674264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.674268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.674273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.674276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.674281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.674285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.674291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.674295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.674300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.674304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.674309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.674313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.674318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.674353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:47.678237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:47.679127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:47.679148Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:47.679151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:47.679154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:47.679161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2636 [2:7556256855997683480:6639]
2025-10-01T14:15:47.679176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:47.679192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:47.679200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.679204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.679206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.679221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:47.679227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:47.679233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:47.679298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.679306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.679308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.679310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:47.679313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:47.679378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:47.679386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.679398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.679412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.679434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:47.679455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374605193:6121], now have 1 active actors on pipe
2025-10-01T14:15:47.679462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374604974:2446], now have 1 active actors on pipe
2025-10-01T14:15:47.679470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.679473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.679475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.679488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:47.679507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:47.679526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:47.679533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:47.679560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.679567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:47.679577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:47.679580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:47.679582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:47.679588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:47.682541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2636
2025-10-01T14:15:47.682602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2636
2025-10-01T14:15:47.685194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.685212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.685250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad6594d-66b06729-302af246-cfe69454_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:47.685266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.685272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.685279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:47.685293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.685314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:47.685342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.686245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.686262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.686286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.686482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2637 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad6594d-66b06729-302af246-cfe69454_0
2025-10-01T14:15:47.686995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6485e088-40bd9eb8-afa6025c-beff0476_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad6594d-66b06729-302af246-cfe69454_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:47.689881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Write session: try to update token
2025-10-01T14:15:47.689908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:47.727699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:47.727718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:47.727720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:47.727723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:47.727732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.727736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.727741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256855997683474:6639]
2025-10-01T14:15:47.727790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:47.727798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.727801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:47.727937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:47.730681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:47.730690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:47.730693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:47.733347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId: src_id|ad6594d-66b06729-302af246-cfe69454_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:47.735105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256858374605206:5610]
2025-10-01T14:15:47.735988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:47.739662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2636, pipe: [1:7556256858374605206:5610]
2025-10-01T14:15:47.890096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:47.890525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.890541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.890563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374605206:5610], now have 1 active actors on pipe
2025-10-01T14:15:47.891442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:47.891663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256858374605206:5610]
2025-10-01T14:15:47.891692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:47.891754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad6594d-66b06729-302af246-cfe69454_0
2025-10-01T14:15:47.892043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:47.892053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Write session will restart in 0.008954s
2025-10-01T14:15:47.892079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Write session: Do CDS request
2025-10-01T14:15:47.892085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:47.891916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2637 sessionId: src_id|ad6594d-66b06729-302af246-cfe69454_0 is DEAD
2025-10-01T14:15:47.892077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:47.905990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.906084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:47.906101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2638
2025-10-01T14:15:47.906238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:47.906281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:47.906290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:47.906295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:47.906718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2638 sessionId:  describe result for acl check
2025-10-01T14:15:47.906754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:47.906762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:47.906763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:47.906768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256858374605224:6142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:47.907274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256858374605224:6142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:47.910404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256858374605224:6142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:47.917141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256858374605224:6142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:47.917155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256858374605224:6142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:47.917157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256858374605224:6142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:47.917163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:47.921728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:47.923641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:47.923810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:47.923820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:47.923830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:47.923866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:47.923894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256855997683733:6634]
2025-10-01T14:15:47.924317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:47.925392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:47.925430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:47.925668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:47.925708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.925712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.925713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.925713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.925714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.925715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.925715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.925716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.925717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.925718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.925718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.925720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.925720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.925721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.925725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.925731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.925733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.925736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.925738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.925740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.925742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.925744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.925746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.925748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.925750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.925752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.925754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.925756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.925761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.925766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:47.925770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.925773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:47.925775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.925778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:47.925780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.925783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:47.925786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.925789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:47.925791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.925794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:47.925797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.925800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:47.925802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.925805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:47.925809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.925812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:47.925814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.925817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.925820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.925822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.925825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.925827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.925829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.925832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:47.925840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.925852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:47.925878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:47.929730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:47.930366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:47.930387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:47.930388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:47.930391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:47.930396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2637 [2:7556256855997683733:6634]
2025-10-01T14:15:47.930407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:47.930422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:47.930423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.930425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.930427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.930442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:47.930447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:47.930454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:47.930503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.930504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.930506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.930508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:47.930510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:47.930570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:47.930574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.930585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:47.930592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:47.930601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:47.930619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.930621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.930623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.930636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:47.930648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:47.930662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:47.930665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:47.930679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:47.930682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:47.930684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:47.930695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.930697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:47.930756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:47.930829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374605377:6142], now have 1 active actors on pipe
2025-10-01T14:15:47.930834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374605211:2446], now have 1 active actors on pipe
2025-10-01T14:15:47.930877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2637
2025-10-01T14:15:47.930911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2637
2025-10-01T14:15:47.930992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.931005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.931036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:47.931048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:47.931056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:47.931058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:47.931066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:47.931076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:47.931092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.931336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.931344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.931360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:47.931495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2638 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0
2025-10-01T14:15:47.931853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6594d-66b06729-302af246-cfe69454_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:47.934617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Write session: try to update token
2025-10-01T14:15:47.934636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:47.950059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId: src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:47.952706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:47.952884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:47.952908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:47.954933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:47.954948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:47.954951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:47.954953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:47.954962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.954967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.954973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256855997683728:6634]
2025-10-01T14:15:47.955021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:47.955038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:47.955049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:47.955051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:47.955083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:47.955089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:47.955092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:47.955188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:47.955225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:47.990594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256858374605441:5610]
2025-10-01T14:15:47.990887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2637, pipe: [1:7556256858374605441:5610]
2025-10-01T14:15:48.149425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:48.160390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:48.160419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:48.160633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.160707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.160782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.160854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.160907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.160913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.160994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.161060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.161133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.161206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.161249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.161253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.161320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.161374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.161434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.161489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.161534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.161538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.161606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.161670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.161736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.161799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.161844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.161847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.161927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.161993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.162058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.162120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.162162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.162165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.162244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.162314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.162407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.162481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.162526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.162529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.165012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:48.165039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:48.165068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2638 reason: error at write: Disconnected sessionId: src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0
2025-10-01T14:15:48.162606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.162686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.162760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.162827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.162871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.162873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.162949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.163017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.163084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.163160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.163206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.163209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.163291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.163358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.163441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.163515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.163557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.163560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.163638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:48.163705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:48.163778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:48.163843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:48.163888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:48.163891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:48.163960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256858374605441:5610], now have 1 active actors on pipe
2025-10-01T14:15:48.165422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:48.165293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2638 sessionId: src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0 is DEAD
2025-10-01T14:15:48.165479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:48.165883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256858374605441:5610]
2025-10-01T14:15:48.166284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:48.166294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Write session will restart in 0.007315s
2025-10-01T14:15:48.166325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Write session: Do CDS request
2025-10-01T14:15:48.166332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:48.174952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:48.175256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:48.175271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2639
2025-10-01T14:15:48.175378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:48.175404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:48.175409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:48.175413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:48.175768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2639 sessionId:  describe result for acl check
2025-10-01T14:15:48.175794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:48.175796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:48.175797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:48.175802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256862669572761:6145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:48.176277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256862669572761:6145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:48.178212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256862669572761:6145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:48.185942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256862669572761:6145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:48.185965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256862669572761:6145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:48.185969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256862669572761:6145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:48.185979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:48.207418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:48.218641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:48.220644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:48.220655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:48.220671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:48.220751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:48.220788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256860292651270:6625]
2025-10-01T14:15:48.221416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:48.222670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:48.222732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:48.223091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:48.223190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.223191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.223193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.223194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.223195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.223197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.223198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.223199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.223200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.223202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.223203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.223205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.223206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.223207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.223214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.223225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.223229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.223233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.223237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.223241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.223244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.223248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.223251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.223255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.223258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.223262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.223267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.223270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.223281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.223288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.223296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.223302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.223308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.223314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.223319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.223324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.223330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.223335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.223339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.223345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.223350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.223355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.223361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.223366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.223371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.223376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.223380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.223386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.223391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.223396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.223402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.223407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.223413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.223418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.223422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.223430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.223470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:48.231403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:48.232028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:48.232044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:48.232046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:48.232050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:48.232057Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2638 [2:7556256860292651270:6625]
2025-10-01T14:15:48.232074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:48.232092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:48.232095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:48.232099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:48.232102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:48.232121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:48.232132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:48.232140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:48.232202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.232209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.232211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.232215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:48.232217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:48.232289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:48.232296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.232308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.232318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.232335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:48.232351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.232364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.232366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.232381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:48.232399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:48.232414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:48.232418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:48.232460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.232468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:48.232681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:48.232691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:48.232698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:48.232703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:48.232931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256862669572753:2446], now have 1 active actors on pipe
2025-10-01T14:15:48.232943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256862669572804:6145], now have 1 active actors on pipe
2025-10-01T14:15:48.233462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2638
2025-10-01T14:15:48.233504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2638
2025-10-01T14:15:48.234870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:48.234886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:48.234920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7525e932-af68112-b35da417-50d1c1bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:48.234932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:48.234937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:48.234941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:48.234952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:48.234967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:48.234986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:48.235265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:48.235273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:48.235290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:48.235808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2639 partition: 0 MaxSeqNo: 45 sessionId: src_id|7525e932-af68112-b35da417-50d1c1bf_0
2025-10-01T14:15:48.238497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae6fd14d-f4e5a7bf-b35a458a-db0caf52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7525e932-af68112-b35da417-50d1c1bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:48.241289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Write session: try to update token
2025-10-01T14:15:48.241309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:48.258770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:48.258790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:48.258793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:48.258795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:48.258806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.258810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.258814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256860292651264:6625]
2025-10-01T14:15:48.258867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:48.258876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.258879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:48.259027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:48.263401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:48.263418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:48.263422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:48.266021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256862669572987:5610]
2025-10-01T14:15:48.269293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2638, pipe: [1:7556256862669572987:5610]
2025-10-01T14:15:48.278439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId: src_id|7525e932-af68112-b35da417-50d1c1bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:48.281722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:48.551952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:48.552337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256862669572987:5610], now have 1 active actors on pipe
2025-10-01T14:15:48.552378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:48.552386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:48.555078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:48.559430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256862669572987:5610]
2025-10-01T14:15:48.559457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:48.559491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:48.559571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7525e932-af68112-b35da417-50d1c1bf_0
2025-10-01T14:15:48.559755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2639 sessionId: src_id|7525e932-af68112-b35da417-50d1c1bf_0 is DEAD
2025-10-01T14:15:48.560183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:48.560191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Write session will restart in 0.005410s
2025-10-01T14:15:48.560221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Write session: Do CDS request
2025-10-01T14:15:48.560227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:48.567190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:48.568551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:48.568569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2640
2025-10-01T14:15:48.581273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:48.581335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:48.581341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:48.581347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:48.582343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2640 sessionId:  describe result for acl check
2025-10-01T14:15:48.582411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:48.582412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:48.582414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:48.582419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256862669573035:6168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:48.582918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256862669573035:6168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:48.601896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256862669573035:6168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:48.614399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256862669573035:6168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:48.614413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256862669573035:6168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:48.614416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256862669573035:6168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:48.614425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:48.629613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:48.633115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:48.633368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:48.633373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:48.633385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:48.633435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:48.633473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256860292651502:6623]
2025-10-01T14:15:48.634054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:48.635955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:48.636023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:48.636408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:48.636472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.636474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.636475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.636476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.636478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.636479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.636480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.636481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.636483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.636484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.636485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.636487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.636488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.636490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.636496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.636508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.636512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.636530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.636534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.636538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.636542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.636546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.636551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.636555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.636559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.636563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.636567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.636571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.636579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.636589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:48.636595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.636601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:48.636608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.636614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:48.636619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.636624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:48.636629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.636635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:48.636640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.636645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:48.636650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.636655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:48.636660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.636666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:48.636670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.636675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:48.636681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.636688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.636693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.636699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.636703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.636709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.636714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.636719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:48.636723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.636729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:48.636785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:48.645371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:48.646247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:48.646253Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:48.646256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:48.646260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:48.646268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2639 [2:7556256860292651502:6623]
2025-10-01T14:15:48.646286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:48.646305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:48.646308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:48.646312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:48.646315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:48.646335Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:48.646342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:48.646349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:48.646433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.646435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.646436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.646440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:48.646443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:48.646513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:48.646516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.646530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:48.646542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:48.646562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:48.646580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.646582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.646584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.646596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:48.646612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:48.646627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:48.646630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:48.646671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.646673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:48.647032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:48.647035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:48.647037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:48.647042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:48.647838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2639
2025-10-01T14:15:48.647871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2639
2025-10-01T14:15:48.647717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256862669573000:2446], now have 1 active actors on pipe
2025-10-01T14:15:48.647735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256862669573230:6168], now have 1 active actors on pipe
2025-10-01T14:15:48.648270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:48.648280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:48.648312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:48.648321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:48.648326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:48.648329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:48.648341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:48.648354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:48.648372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:48.648695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:48.648702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:48.648720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:48.648867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2640 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0
2025-10-01T14:15:48.650926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7525e932-af68112-b35da417-50d1c1bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:48.653766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Write session: try to update token
2025-10-01T14:15:48.653786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:48.659249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256862669573256:5610]
2025-10-01T14:15:48.659708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256862669573256:5610], now have 1 active actors on pipe
2025-10-01T14:15:48.659899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2639, pipe: [1:7556256862669573256:5610]
2025-10-01T14:15:48.682890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:48.682908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:48.682911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:48.682914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:48.682924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.682929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.682932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256860292651496:6623]
2025-10-01T14:15:48.682984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:48.682991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:48.682994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:48.683170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:48.686556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:48.686567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:48.686571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:48.714473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId: src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:48.717502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:49.005620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:49.007078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.007100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.010845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:49.012052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:49.012066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:49.012126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2640 reason: error at write: Disconnected sessionId: src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0
2025-10-01T14:15:49.012314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2640 sessionId: src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0 is DEAD
2025-10-01T14:15:49.012441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:49.012478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256862669573256:5610]
2025-10-01T14:15:49.020388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:49.020402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Write session will restart in 0.007475s
2025-10-01T14:15:49.020432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Write session: Do CDS request
2025-10-01T14:15:49.020442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:49.029243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.034630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:49.034648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2641
2025-10-01T14:15:49.034820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.034848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:49.034854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:49.034858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:49.035415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2641 sessionId:  describe result for acl check
2025-10-01T14:15:49.035464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:49.035466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:49.035468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:49.035472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256866964540577:6199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:49.036022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256866964540577:6199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:49.062279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256866964540577:6199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:49.074557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256866964540577:6199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:49.074583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256866964540577:6199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:49.074586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256866964540577:6199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:49.074595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:49.080796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:49.084427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:49.084801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:49.084806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:49.084818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:49.084879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:49.084912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256864587619079:6598]
2025-10-01T14:15:49.085506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:49.086190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:49.086262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:49.086613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:49.086698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.086704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.086705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.086707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.086708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.086709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.086710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.086711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.086712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.086713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.086714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.086715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.086717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.086718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.086723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.086733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.086737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.086741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.086744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.086748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.086752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.086755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.086759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.086763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.086767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.086770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.086773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.086777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.086785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.086792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.086800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.086806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.086811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.086816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.086821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.086831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.086836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.086840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.086849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.086853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.086859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.086868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.086872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.086877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.086886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.086892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.086910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.086915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.086924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.086929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.086933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.086938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.086942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.086951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.086956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.086966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.087007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:49.092152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:49.092757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:49.092771Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:49.092774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:49.092778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:49.092785Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2640 [2:7556256864587619079:6598]
2025-10-01T14:15:49.092802Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:49.092821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:49.092824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.092828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.092830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.092845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:49.092852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:49.092858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:49.092920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.092923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.092925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.092928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:49.092931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:49.093002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:49.093005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.093016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.093026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.093040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:49.093058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.093060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.093062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.093076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:49.093091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:49.093105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:49.093108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:49.093143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.093146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:49.093278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:49.093280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:49.093282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:49.093289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:49.094356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2640
2025-10-01T14:15:49.094403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2640
2025-10-01T14:15:49.095390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964540771:6199], now have 1 active actors on pipe
2025-10-01T14:15:49.095405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964540563:2446], now have 1 active actors on pipe
2025-10-01T14:15:49.095430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.095436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.095467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5db9bf45-a220d965-428763aa-f66458b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:49.095478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.095483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.095486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:49.095497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.095512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:49.095528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.098256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.098267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.098292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.098472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2641 partition: 0 MaxSeqNo: 45 sessionId: src_id|5db9bf45-a220d965-428763aa-f66458b3_0
2025-10-01T14:15:49.098887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bed2-9ce59b8-5a83865d-7c5b0c57_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5db9bf45-a220d965-428763aa-f66458b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:49.101418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Write session: try to update token
2025-10-01T14:15:49.101435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:49.114456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256866964540795:5610]
2025-10-01T14:15:49.117136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964540795:5610], now have 1 active actors on pipe
2025-10-01T14:15:49.117273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2640, pipe: [1:7556256866964540795:5610]
2025-10-01T14:15:49.122543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:49.122558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:49.122560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:49.122563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:49.122573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.122579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.122582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256864587619073:6598]
2025-10-01T14:15:49.122630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:49.122637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.122640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:49.122780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:49.127278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:49.127289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:49.127293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:49.146435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId: src_id|5db9bf45-a220d965-428763aa-f66458b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:49.149077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:49.308313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:49.308966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.308975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.309947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:49.309988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256866964540795:5610]
2025-10-01T14:15:49.310003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:49.310005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:49.310053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2641 reason: error at write: Disconnected sessionId: src_id|5db9bf45-a220d965-428763aa-f66458b3_0
2025-10-01T14:15:49.310213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2641 sessionId: src_id|5db9bf45-a220d965-428763aa-f66458b3_0 is DEAD
2025-10-01T14:15:49.310581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:49.310593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Write session will restart in 0.008101s
2025-10-01T14:15:49.310618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Write session: Do CDS request
2025-10-01T14:15:49.310624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:49.310903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:49.323212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.323540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:49.323554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2642
2025-10-01T14:15:49.324038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.324074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:49.324080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:49.324084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:49.325476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2642 sessionId:  describe result for acl check
2025-10-01T14:15:49.325513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:49.325515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:49.325517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:49.325522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256866964540848:6202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:49.326032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256866964540848:6202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:49.343763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256866964540848:6202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:49.352989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256866964540848:6202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:49.353008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256866964540848:6202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:49.353011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256866964540848:6202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:49.353020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:49.359611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:49.362230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:49.362476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:49.362485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:49.362497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:49.362551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:49.362591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256864587619309:6595]
2025-10-01T14:15:49.363232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:49.363601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:49.363645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:49.363963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:49.364019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.364024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.364025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.364027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.364028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.364029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.364030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.364032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.364033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.364035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.364036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.364037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.364038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.364040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.364046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.364057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.364060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.364065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.364069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.364073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.364077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.364081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.364085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.364090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.364094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.364098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.364102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.364106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.364114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.364126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.364132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.364136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.364141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.364146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.364150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.364154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.364159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.364165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.364169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.364174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.364179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.364184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.364189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.364196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.364200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.364205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.364208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.364213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.364217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.364221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.364225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.364231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.364236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.364242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.364246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.364252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.364311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:49.368402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:49.369521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:49.369537Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:49.369540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:49.369544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:49.369551Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2641 [2:7556256864587619309:6595]
2025-10-01T14:15:49.369567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:49.369584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:49.369592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.369596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.369599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.369616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:49.369630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:49.369637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:49.369705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.369711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.369713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.369717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:49.369720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:49.370088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2641
2025-10-01T14:15:49.370118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2641
2025-10-01T14:15:49.369793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:49.369800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.369813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.369822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.369838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:49.369855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.369857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.369859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.369867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:49.369872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:49.369875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:49.369877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:49.369882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541035:6202], now have 1 active actors on pipe
2025-10-01T14:15:49.369885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964540816:2446], now have 1 active actors on pipe
2025-10-01T14:15:49.369893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:49.369906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:49.369909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:49.369946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.369952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:49.370274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:49.370323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.370328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.370355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27ef4820-381e4bb7-4d04b336-469aef42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:49.370363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.370367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.370387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:49.370398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.370409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:49.370425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.370891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.370899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.370917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.373912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2642 partition: 0 MaxSeqNo: 45 sessionId: src_id|27ef4820-381e4bb7-4d04b336-469aef42_0
2025-10-01T14:15:49.374593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db9bf45-a220d965-428763aa-f66458b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|27ef4820-381e4bb7-4d04b336-469aef42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:49.377023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Write session: try to update token
2025-10-01T14:15:49.377039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:49.394928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:49.394943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:49.394946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:49.394948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:49.394958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.394963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.394967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256864587619303:6595]
2025-10-01T14:15:49.395020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:49.395028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.395031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:49.395186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:49.395761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:49.395767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:49.395771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:49.410794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256866964541050:5610]
2025-10-01T14:15:49.411860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2641, pipe: [1:7556256866964541050:5610]
2025-10-01T14:15:49.413334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId: src_id|27ef4820-381e4bb7-4d04b336-469aef42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:49.415966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:49.570158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:49.570495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541050:5610], now have 1 active actors on pipe
2025-10-01T14:15:49.570531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.570539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.573890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:49.575349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256866964541050:5610]
2025-10-01T14:15:49.575378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:49.575458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27ef4820-381e4bb7-4d04b336-469aef42_0
2025-10-01T14:15:49.575626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2642 sessionId: src_id|27ef4820-381e4bb7-4d04b336-469aef42_0 is DEAD
2025-10-01T14:15:49.575763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:49.578560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:49.578572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Write session will restart in 0.009293s
2025-10-01T14:15:49.578598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Write session: Do CDS request
2025-10-01T14:15:49.578603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:49.590740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.591021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:49.591037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2643
2025-10-01T14:15:49.591173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.591218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:49.591224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:49.591228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:49.591677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2643 sessionId:  describe result for acl check
2025-10-01T14:15:49.591712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:49.591714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:49.591716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:49.591721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256866964541083:6219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:49.592543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256866964541083:6219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:49.599978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256866964541083:6219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:49.604343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256866964541083:6219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:49.604363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256866964541083:6219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:49.604366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256866964541083:6219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:49.604374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:49.608802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:49.610729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:49.611092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:49.611102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:49.611114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:49.611163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:49.611193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256864587619540:6588]
2025-10-01T14:15:49.611733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:49.612052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:49.612110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:49.612333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:49.612368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.612369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.612370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.612370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.612371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.612372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.612373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.612373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.612374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.612375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.612375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.612376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.612377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.612378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.612382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.612388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.612390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.612392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.612394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.612396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.612398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.612401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.612403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.612405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.612407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.612409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.612411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.612413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.612418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.612423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.612427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.612430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.612432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.612435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.612437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.612440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.612443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.612446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.612449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.612451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.612454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.612457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.612459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.612462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.612464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.612468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.612470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.612473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.612475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.612479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.612481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.612484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.612487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.612489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.612493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.612495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.612531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:49.620000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:49.620603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:49.620617Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:49.620621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:49.620624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:49.620631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2642 [2:7556256864587619540:6588]
2025-10-01T14:15:49.620648Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:49.620666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:49.620669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.620673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.620676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.620691Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:49.620701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:49.620709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:49.620765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.620771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.620773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.620776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:49.620779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:49.620847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:49.620857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.620868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.620880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.620896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:49.620916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.620925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.620927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.620938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:49.620946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:49.620949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:49.620951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:49.620953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:49.620967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:49.620970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:49.620980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541259:6219], now have 1 active actors on pipe
2025-10-01T14:15:49.620984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541058:2446], now have 1 active actors on pipe
2025-10-01T14:15:49.621020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.621028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:49.621056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2642
2025-10-01T14:15:49.621103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2642
2025-10-01T14:15:49.621175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:49.622366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.622396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.622429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:49.622438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.622443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.622446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:49.622457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.622471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:49.622490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.622677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.622689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.622711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.622810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2643 partition: 0 MaxSeqNo: 45 sessionId: src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0
2025-10-01T14:15:49.624475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ef4820-381e4bb7-4d04b336-469aef42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:49.627147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Write session: try to update token
2025-10-01T14:15:49.627165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:49.646412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId: src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:49.649044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:49.649787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:49.649643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.649661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.649713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:49.651631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:49.651635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:49.651637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:49.651639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:49.651647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.651653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.651656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256864587619535:6588]
2025-10-01T14:15:49.651706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:49.651713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.651715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:49.651718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:49.651725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:49.651729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:49.651844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:49.675055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256866964541314:5610]
2025-10-01T14:15:49.678615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2642, pipe: [1:7556256866964541314:5610]
2025-10-01T14:15:49.811123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:49.819863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.819895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.820077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.820134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.820193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.820253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.820402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.820408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.820487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.820556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.820612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.820674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.820715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.820718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.820778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.820827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.820882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.820936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.820973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.820976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.821035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.821091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.821145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.821194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.821228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.821234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.821290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.821338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.821388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.821440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.821482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.821485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.821552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.821609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.821666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.821726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.821766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.821768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.821830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.821885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.821945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.822006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.822049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.822052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.822115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.822172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.822231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.822293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.824147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:49.824171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:49.824204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2643 reason: error at write: Disconnected sessionId: src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0
2025-10-01T14:15:49.824435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2643 sessionId: src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0 is DEAD
2025-10-01T14:15:49.824604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256866964541314:5610]
2025-10-01T14:15:49.824628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:49.822663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.822672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.822747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.822811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.822873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.822934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.822976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.822979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.823050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:49.823114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:49.823175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:49.823238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:49.823280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:49.823283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:49.823361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541314:5610], now have 1 active actors on pipe
2025-10-01T14:15:49.824666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:49.826636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:49.826649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Write session will restart in 0.005053s
2025-10-01T14:15:49.826685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Write session: Do CDS request
2025-10-01T14:15:49.826692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:49.833002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.833055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:49.833073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2644
2025-10-01T14:15:49.834587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:49.834644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:49.834658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:49.834667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:49.835080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2644 sessionId:  describe result for acl check
2025-10-01T14:15:49.835119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:49.835126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:49.835128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:49.835135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256866964541333:6263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:49.835666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256866964541333:6263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:49.839995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256866964541333:6263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:49.847665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256866964541333:6263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:49.847684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256866964541333:6263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:49.847688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256866964541333:6263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:49.847697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:49.868581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:49.871312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:49.871549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:49.871562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:49.871575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:49.871636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:49.871675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256864587619789:6582]
2025-10-01T14:15:49.872280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:49.872960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:49.873032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:49.873506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:49.873591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.873598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.873599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.873600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.873601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.873603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.873604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.873606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.873607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.873608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.873609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.873610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.873611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.873613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.873619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.873629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.873633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.873637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.873641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.873644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.873646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.873648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.873650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.873653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.873655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.873657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.873659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.873661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.873667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.873673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:49.873678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.873681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:49.873684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.873687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:49.873689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.873692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:49.873695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.873698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:49.873700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.873703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:49.873707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.873709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:49.873714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.873717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:49.873719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.873722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:49.873725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.873728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.873730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.873733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.873735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.873738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.873741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.873747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:49.873752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.873756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:49.873798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:49.878120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:49.878752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:49.878767Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:49.878771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:49.878776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:49.878784Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2643 [2:7556256864587619789:6582]
2025-10-01T14:15:49.878803Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:49.878822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:49.878825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.878829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.878831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.878849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:49.878855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:49.878862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:49.878924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.878927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.878929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.878933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:49.878936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:49.878995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:49.878998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.879009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:49.879020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:49.879036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:49.879054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.879056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.879058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.879073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:49.879089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:49.879103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:49.879106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:49.879137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.879139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:49.879167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541371:6263], now have 1 active actors on pipe
2025-10-01T14:15:49.879172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541326:2446], now have 1 active actors on pipe
2025-10-01T14:15:49.879241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:49.879244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:49.879246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:49.879251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:49.879497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2643
2025-10-01T14:15:49.879532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2643
2025-10-01T14:15:49.879567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.879582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.879615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:49.879630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:49.879635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:49.879638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:49.879648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:49.879658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:49.879678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.879871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.880012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2644 partition: 0 MaxSeqNo: 45 sessionId: src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0
2025-10-01T14:15:49.879875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.879900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:49.880393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b2d891-d2480ce2-5539609b-c0e660ac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:49.882925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Write session: try to update token
2025-10-01T14:15:49.882944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:49.910314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId: src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:49.912850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:49.913919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:49.913942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:49.913985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:49.916277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:49.926717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:49.926732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:49.926735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:49.926737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:49.926748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.926754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.926758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256864587619784:6582]
2025-10-01T14:15:49.926809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:49.926817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:49.926820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:49.926958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:49.930539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:49.930551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:49.930556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:49.930646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256866964541562:5610]
2025-10-01T14:15:49.935255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2643, pipe: [1:7556256866964541562:5610]
2025-10-01T14:15:50.101326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:50.101722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256866964541562:5610], now have 1 active actors on pipe
2025-10-01T14:15:50.109239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.109259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.109421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.109477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.109538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.109595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.109639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.109644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.109708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.109763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.109823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.109884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.109924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.109928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.109987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.110038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.110093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.110147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.110187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.110190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.110249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.110303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.110359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.110570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.110614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.110617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.110683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.110739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.110795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.110852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.110896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.110899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.110969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.111027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.111104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.111164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.111209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.111212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.111278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.111335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.111396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.111460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.111503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.111506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.111576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.111632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.111693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.111751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.111793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.111796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.111861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.111918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.111974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.112036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.112077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.112080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.112147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.112203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.112260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.112320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.112362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.112366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.113209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:50.113221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:50.113249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2644 reason: error at write: Disconnected sessionId: src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0
2025-10-01T14:15:50.113432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2644 sessionId: src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0 is DEAD
2025-10-01T14:15:50.113559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:50.113605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256866964541562:5610]
2025-10-01T14:15:50.114572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:50.114582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Write session will restart in 0.009644s
2025-10-01T14:15:50.114606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Write session: Do CDS request
2025-10-01T14:15:50.114611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:50.114315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:50.130971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.136284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:50.136302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2645
2025-10-01T14:15:50.136557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.136586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:50.136591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:50.136596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:50.137066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2645 sessionId:  describe result for acl check
2025-10-01T14:15:50.137091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:50.137093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:50.137095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:50.137100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256871259508934:6270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:50.137623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256871259508934:6270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:50.142609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256871259508934:6270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:50.150930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256871259508934:6270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:50.153244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:50.150950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256871259508934:6270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:50.156488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:50.156728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:50.156733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:50.156746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:50.156805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:50.156843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256868882587349:6569]
2025-10-01T14:15:50.157433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:50.157822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:50.157857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:50.158191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:50.158236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.158237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.158238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.158239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.158240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.158241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.158242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.158243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.158244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.158245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.158246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.158248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.158249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.158250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.158253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.158262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.158266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.158269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.158272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.158275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.158278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.158281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.158285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.158289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.158292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.158295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.158299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.158302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.158309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.158317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.158323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.158327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.158331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.158335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.158339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.158343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.158347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.158351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.158355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.158359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.158364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.158383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.158388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.158392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.158397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.158401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.158405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.158409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.158413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.158417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.158421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.158429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.158433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.158437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.158441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.158478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:50.150954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256871259508934:6270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:50.150963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:50.164985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2644
2025-10-01T14:15:50.165026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2644
2025-10-01T14:15:50.165874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2645 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4e8abc4-710768d-8743e281-e678469_0
2025-10-01T14:15:50.162893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:50.163804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:50.163810Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:50.163813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:50.163817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:50.163824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2644 [2:7556256868882587349:6569]
2025-10-01T14:15:50.163842Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:50.163861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:50.163864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.163868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.163871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.163890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:50.163897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:50.163904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:50.163964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.163966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.163968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.163971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:50.163974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:50.164049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:50.164053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.164065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.164075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.164090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:50.164109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.164111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.164113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.164127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:50.164142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:50.164156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:50.164159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:50.164199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.164202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:50.164289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:50.164291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:50.164293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:50.164298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:50.165249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259508865:2446], now have 1 active actors on pipe
2025-10-01T14:15:50.165254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509090:6270], now have 1 active actors on pipe
2025-10-01T14:15:50.165273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.165279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.165309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4e8abc4-710768d-8743e281-e678469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:50.165318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.165323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.165327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:50.165337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.165350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:50.165367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.165717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.165721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.165734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.170689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f651f7-e35b2f56-2ef7af0d-74b9dad2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4e8abc4-710768d-8743e281-e678469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:50.173644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Write session: try to update token
2025-10-01T14:15:50.173664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:50.192789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:50.192807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:50.192811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:50.192812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:50.192823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.192828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.192832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256868882587343:6569]
2025-10-01T14:15:50.192881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:50.192888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.192891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:50.193023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:50.193051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:50.193058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:50.193062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:50.197648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId: src_id|f4e8abc4-710768d-8743e281-e678469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:50.200207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:50.214469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256871259509117:5610]
2025-10-01T14:15:50.214936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2644, pipe: [1:7556256871259509117:5610]
2025-10-01T14:15:50.397921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:50.398539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.398550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.398572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509117:5610], now have 1 active actors on pipe
2025-10-01T14:15:50.398944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:50.399250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:50.399301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256871259509117:5610]
2025-10-01T14:15:50.399318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:50.399320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:50.399374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2645 reason: error at write: Disconnected sessionId: src_id|f4e8abc4-710768d-8743e281-e678469_0
2025-10-01T14:15:50.399552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2645 sessionId: src_id|f4e8abc4-710768d-8743e281-e678469_0 is DEAD
2025-10-01T14:15:50.400049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:50.400058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Write session will restart in 0.006701s
2025-10-01T14:15:50.400085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Write session: Do CDS request
2025-10-01T14:15:50.400092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:50.407890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.408187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:50.408201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2646
2025-10-01T14:15:50.408373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.408409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:50.408414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:50.408417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:50.409794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2646 sessionId:  describe result for acl check
2025-10-01T14:15:50.409830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:50.409832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:50.409834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:50.409839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256871259509128:6285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:50.410317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256871259509128:6285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:50.412439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256871259509128:6285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:50.414438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256871259509128:6285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:50.414458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256871259509128:6285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:50.414461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256871259509128:6285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:50.414468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:50.442986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:50.445877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:50.446106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:50.446117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:50.446130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:50.446202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:50.446249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256868882587585:6561]
2025-10-01T14:15:50.446860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:50.447182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:50.447229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:50.447528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:50.447595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.447601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.447602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.447603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.447605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.447606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.447607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.447608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.447610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.447611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.447612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.447613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.447614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.447615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.447622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.447632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.447636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.447641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.447644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.447648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.447652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.447656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.447660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.447664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.447667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.447671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.447674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.447677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.447687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.447694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.447701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.447706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.447716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.447721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.447726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.447736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.447742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.447751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.447755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.447760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.447769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.447774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.447781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.447787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.447796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.447802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.447812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.447817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.447825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.447831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.447839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.447844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.447849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.447860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.447864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.447871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.447908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:50.455136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:50.456301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:50.456308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:50.456310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:50.456315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:50.456323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2645 [2:7556256868882587585:6561]
2025-10-01T14:15:50.456340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:50.456360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:50.456364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.456368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.456370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.456388Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:50.456394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:50.456401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:50.456473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.456476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.456477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.456480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:50.456483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:50.456576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:50.456579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.456606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.456616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.456630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:50.456649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.456651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.456652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.456666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:50.456682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:50.456697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:50.456700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:50.456744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.456746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:50.456944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:50.456946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:50.456948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:50.456954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:50.457303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2645
2025-10-01T14:15:50.457358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2645
2025-10-01T14:15:50.457761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509120:2446], now have 1 active actors on pipe
2025-10-01T14:15:50.457771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509167:6285], now have 1 active actors on pipe
2025-10-01T14:15:50.457791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.457797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.457834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|367beacf-82c7ec4f-47532d97-a31a414b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:50.457843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.457849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.457851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:50.457862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.457874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:50.457891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.458613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.458623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.458643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.458792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2646 partition: 0 MaxSeqNo: 45 sessionId: src_id|367beacf-82c7ec4f-47532d97-a31a414b_0
2025-10-01T14:15:50.459253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e8abc4-710768d-8743e281-e678469_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|367beacf-82c7ec4f-47532d97-a31a414b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:50.467228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Write session: try to update token
2025-10-01T14:15:50.467254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:50.486922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId: src_id|367beacf-82c7ec4f-47532d97-a31a414b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:50.489557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:50.489791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.489811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.489850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:50.489935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:50.499434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256871259509359:5610]
2025-10-01T14:15:50.500559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509359:5610], now have 1 active actors on pipe
2025-10-01T14:15:50.500734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2645, pipe: [1:7556256871259509359:5610]
2025-10-01T14:15:50.503289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:50.503304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:50.503307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:50.503309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:50.503318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.503323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.503328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256868882587579:6561]
2025-10-01T14:15:50.503369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:50.503373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:50.503376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:50.503380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:50.503387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.503389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:50.503525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:50.653863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:50.661972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.661997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.662177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.662244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.662313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.665673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:50.665687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:50.665719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2646 reason: error at write: Disconnected sessionId: src_id|367beacf-82c7ec4f-47532d97-a31a414b_0
2025-10-01T14:15:50.665900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2646 sessionId: src_id|367beacf-82c7ec4f-47532d97-a31a414b_0 is DEAD
2025-10-01T14:15:50.666058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:50.666331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:50.666340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Write session will restart in 0.007627s
2025-10-01T14:15:50.666366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Write session: Do CDS request
2025-10-01T14:15:50.666384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:50.662500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.662550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.662554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.662632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.662693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.662758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.662817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.662856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.662859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.662919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.662976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.663030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.663087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.663127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.663130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.663192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.663251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.663302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.663354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.663393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.663396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.663460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.663515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.663564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.663616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.663652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.663654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.663719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.663779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.663834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.663890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.663929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.663931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.663998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.664050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.664105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.664160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.664197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.664199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.664269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.664324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.664378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.664436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.664477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.664481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.664562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.664620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.664677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.664737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.664782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.664786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.664851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:50.664905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:50.664960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:50.665024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:50.665118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:50.665120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:50.666182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256871259509359:5610]
2025-10-01T14:15:50.666705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:50.677838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.678187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:50.678201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2647
2025-10-01T14:15:50.678408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.678445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:50.678451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:50.678454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:50.680338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2647 sessionId:  describe result for acl check
2025-10-01T14:15:50.680376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:50.680378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:50.680380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:50.680385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256871259509397:6282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:50.680971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256871259509397:6282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:50.689071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256871259509397:6282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:50.698805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256871259509397:6282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:50.698829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256871259509397:6282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:50.698832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256871259509397:6282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:50.698839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:50.710664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:50.714386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:50.714607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:50.714620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:50.714631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:50.714682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:50.714715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256868882587818:6557]
2025-10-01T14:15:50.715298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:50.715826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:50.715865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:50.716161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:50.716213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.716214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.716215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.716216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.716217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.716218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.716219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.716220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.716221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.716222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.716223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.716224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.716224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.716225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.716230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.716239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.716242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.716246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.716249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.716252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.716256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.716259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.716262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.716266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.716269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.716273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.716277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.716280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.716288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.716295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.716301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.716307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.716311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.716316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.716320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.716324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.716328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.716332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.716336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.716341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.716345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.716350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.716354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.716359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.716364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.716369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.716373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.716378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.716382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.716386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.716390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.716394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.716398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.716403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.716407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.716411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.716444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:50.720794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:50.721433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:50.721438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:50.721440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:50.721444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:50.721453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2646 [2:7556256868882587818:6557]
2025-10-01T14:15:50.721468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:50.721484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:50.721488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.721491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.721493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.721508Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:50.721514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:50.721520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:50.721576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.721578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.721580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.721584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:50.721587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:50.721654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:50.721656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.721667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.721677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.721688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:50.721701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.721703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.721704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.721715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:50.721730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:50.721744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:50.721747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:50.721779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.721782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:50.722620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:50.722628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:50.722630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:50.722637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:50.723248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2646
2025-10-01T14:15:50.723286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2646
2025-10-01T14:15:50.723372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509371:2446], now have 1 active actors on pipe
2025-10-01T14:15:50.723386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509514:6282], now have 1 active actors on pipe
2025-10-01T14:15:50.724105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.724112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.724144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:50.724154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.724164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.724167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:50.724178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.724191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:50.724210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.726786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.726798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.726823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.727018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2647 partition: 0 MaxSeqNo: 45 sessionId: src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0
2025-10-01T14:15:50.727461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367beacf-82c7ec4f-47532d97-a31a414b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:50.732877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Write session: try to update token
2025-10-01T14:15:50.732895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:50.751744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId: src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:50.754096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:50.754266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.754292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.754314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:50.754316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:50.754319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:50.754321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:50.754329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.754334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.754337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256868882587812:6557]
2025-10-01T14:15:50.754387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:50.754392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:50.754395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:50.754402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:50.754408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.754410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:50.754548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:50.774001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256871259509635:5610]
2025-10-01T14:15:50.777809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2646, pipe: [1:7556256871259509635:5610]
2025-10-01T14:15:50.779746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:15:50.779761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-01T14:15:50.916144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:50.916551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:50.916605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509635:5610], now have 1 active actors on pipe
2025-10-01T14:15:50.917179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:50.917286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:50.917289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:50.917364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2647 reason: error at write: Disconnected sessionId: src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0
2025-10-01T14:15:50.917515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2647 sessionId: src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0 is DEAD
2025-10-01T14:15:50.917541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:50.917554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-01T14:15:50.917584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256871259509635:5610]
2025-10-01T14:15:50.917764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:50.917776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Write session will restart in 0.009321s
2025-10-01T14:15:50.917802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Write session: Do CDS request
2025-10-01T14:15:50.917809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:50.928621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.929647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:50.929662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2648
2025-10-01T14:15:50.929820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:50.929850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:50.929856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:50.929859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:50.930304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2648 sessionId:  describe result for acl check
2025-10-01T14:15:50.930339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:50.930343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:50.930345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:50.930350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256871259509682:6314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:50.930844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256871259509682:6314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:50.944077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256871259509682:6314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:50.959938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256871259509682:6314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:50.959955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256871259509682:6314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:50.959958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256871259509682:6314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:50.959967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:50.963079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:50.963776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:50.963952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:50.963961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:50.963971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:50.964009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:50.964044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256868882588076:6545]
2025-10-01T14:15:50.965996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:50.966388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:50.966430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:50.966741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:50.966779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.966780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.966781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.966782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.966783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.966785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.966786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.966787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.966788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.966789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.966790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.966791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.966792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.966793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.966799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.966808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.966812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.966815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.966819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.966822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.966825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.966828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.966831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.966835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.966838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.966840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.966844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.966847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.966855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.966862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:50.966868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.966873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:50.966877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.966881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:50.966885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.966889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:50.966894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.966898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:50.966902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.966907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:50.966911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.966915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:50.966919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.966923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:50.966927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.966931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:50.966935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.966939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.966945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.966950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.966954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.966958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.966962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.966966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:50.966999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.967004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:50.967039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:50.976073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:50.976673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:50.976683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:50.976686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:50.976690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:50.976697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2647 [2:7556256868882588076:6545]
2025-10-01T14:15:50.976713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:50.977681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2647
2025-10-01T14:15:50.977726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2647
2025-10-01T14:15:50.976730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:50.976740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.976744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.976746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.976761Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:50.976767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:50.976772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:50.976829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.976831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.976833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.976837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:50.976840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:50.976904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:50.976907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:50.976918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:50.976928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:50.976942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:50.976958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:50.976960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:50.976962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:50.976974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:50.976987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:50.977000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:50.977003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:50.977040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:50.977042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:50.977126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:50.977128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:50.977130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:50.977134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:50.982450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509640:2446], now have 1 active actors on pipe
2025-10-01T14:15:50.982464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256871259509867:6314], now have 1 active actors on pipe
2025-10-01T14:15:50.983035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 24 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:15:50.983073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:15:50.982515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.982526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.982616Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:15:50.982646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:50.982654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:50.982659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:50.982662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:50.982672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:50.982686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:50.982704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.983385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:50.983393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:50.983410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:50.985099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efcbe59-a71be6f4-5421685a-798d0a8c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:50.984701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2648 partition: 0 MaxSeqNo: 45 sessionId: src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0
2025-10-01T14:15:50.987979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Write session: try to update token
2025-10-01T14:15:50.987998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:51.008923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:51.008947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:51.008949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:51.008951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:51.008961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:51.008969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:51.008973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256868882588070:6545]
2025-10-01T14:15:51.009028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:51.009043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.009046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:51.009119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:51.009131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:51.009136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:51.009189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:51.008285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId: src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:51.011068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:51.017082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256875554477181:5610]
2025-10-01T14:15:51.018670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2647, pipe: [1:7556256875554477181:5610]
2025-10-01T14:15:51.186065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:51.187713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.187730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.187753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477181:5610], now have 1 active actors on pipe
2025-10-01T14:15:51.191801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:51.191855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:51.191857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:51.191911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2648 reason: error at write: Disconnected sessionId: src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0
2025-10-01T14:15:51.192113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2648 sessionId: src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0 is DEAD
2025-10-01T14:15:51.192254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256875554477181:5610]
2025-10-01T14:15:51.192786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:51.197039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:51.197050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Write session will restart in 0.008699s
2025-10-01T14:15:51.197079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Write session: Do CDS request
2025-10-01T14:15:51.197084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:51.210024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:51.210130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:51.210146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2649
2025-10-01T14:15:51.210348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:51.210392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:51.210397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:51.210400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:51.213785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2649 sessionId:  describe result for acl check
2025-10-01T14:15:51.213814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:51.213815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:51.213816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:51.213821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256875554477234:6325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:51.214199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256875554477234:6325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:51.224802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256875554477234:6325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:51.241852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256875554477234:6325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:51.241871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256875554477234:6325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:51.241874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256875554477234:6325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:51.241929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:51.263423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:51.269455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:51.269771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:51.269776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:51.269788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:51.269858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:51.269898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256873177555639:6523]
2025-10-01T14:15:51.270469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:51.278552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:51.278651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:51.279027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:51.279104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.279106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.279108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.279110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.279111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.279113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.279114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.279115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.279117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.279118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.279119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.279121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.279123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.279124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.279131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.279142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.279147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.279152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.279156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.279160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.279164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.279168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.279171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.279174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.279176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.279178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.279180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.279182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.279189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.279195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.279200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.279203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.279209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.279212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.279215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.279218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.279221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.279225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.279227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.279230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.279233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.279236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.279240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.279243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.279246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.279250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.279252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.279256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.279259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.279263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.279266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.279269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.279274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.279280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.279284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.279290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.279332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:51.294517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256875554477437:5610]
2025-10-01T14:15:51.295600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:51.296225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:51.296231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:51.296234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:51.296239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:51.296247Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2648 [2:7556256873177555639:6523]
2025-10-01T14:15:51.296264Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:51.296282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:51.296285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:51.296290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:51.296292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:51.296309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:51.296315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:51.296321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:51.296385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.296387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.296390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.296393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:51.296396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:51.296745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:51.296748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.296761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.296772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.296793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:51.296808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.296811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.296813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.296829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:51.296845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:51.296862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:51.296865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:51.296906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.296909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:51.296919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477347:6325], now have 1 active actors on pipe
2025-10-01T14:15:51.296919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:51.296923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:51.296925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:51.296932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:51.296937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477201:2446], now have 1 active actors on pipe
2025-10-01T14:15:51.297427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477437:5610], now have 1 active actors on pipe
2025-10-01T14:15:51.297595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.297603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.297633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:51.297643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:51.297648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:51.297650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:51.297659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:51.297670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:51.297691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:51.298059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.298065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.298082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:51.298710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d96f18-6d638de6-3aa5c666-5cf5238b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:51.297434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2648
2025-10-01T14:15:51.297461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2648
2025-10-01T14:15:51.297478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2648, pipe: [1:7556256875554477437:5610]
2025-10-01T14:15:51.298218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2649 partition: 0 MaxSeqNo: 45 sessionId: src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0
2025-10-01T14:15:51.301332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Write session: try to update token
2025-10-01T14:15:51.301349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:51.350388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:51.350407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:51.350410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:51.350413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:51.350424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.350430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.350435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256873177555633:6523]
2025-10-01T14:15:51.350488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:51.350496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.350499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:51.350643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:51.352924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:51.352934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:51.352938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:51.359261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId: src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:51.361881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:51.517538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:51.518078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.518097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.518846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:51.519538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:51.519551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:51.519604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2649 reason: error at write: Disconnected sessionId: src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0
2025-10-01T14:15:51.519768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2649 sessionId: src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0 is DEAD
2025-10-01T14:15:51.519874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:51.519904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256875554477437:5610]
2025-10-01T14:15:51.522913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:51.522924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Write session will restart in 0.007476s
2025-10-01T14:15:51.522950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Write session: Do CDS request
2025-10-01T14:15:51.522960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:51.531888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:51.532104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:51.532119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2650
2025-10-01T14:15:51.533426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:51.533467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:51.533473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:51.533476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:51.534109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2650 sessionId:  describe result for acl check
2025-10-01T14:15:51.534143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:51.534144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:51.534147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:51.534153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256875554477494:6332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:51.534656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256875554477494:6332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:51.540342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256875554477494:6332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:51.544960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256875554477494:6332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:51.544979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256875554477494:6332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:51.544982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256875554477494:6332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:51.544993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:51.562047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:51.565687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:51.566358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:51.566395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:51.566409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:51.566482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:51.566521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256873177555877:6512]
2025-10-01T14:15:51.567093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:51.567524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:51.567564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:51.567969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:51.568024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.568026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.568027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.568028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.568029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.568030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.568031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.568032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.568034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.568035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.568036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.568037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.568038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.568039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.568043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.568053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.568057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.568061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.568065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.568068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.568073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.568077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.568080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.568084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.568087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.568091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.568094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.568097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.568103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.568110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.568116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.568121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.568127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.568132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.568136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.568141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.568146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.568151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.568155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.568160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.568167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.568172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.568176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.568180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.568184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.568190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.568194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.568198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.568214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.568218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.568223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.568227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.568232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.568237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.568241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.568246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.568281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:51.572882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:51.573548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:51.573567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:51.573569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:51.573572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:51.573580Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2649 [2:7556256873177555877:6512]
2025-10-01T14:15:51.573597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:51.573617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:51.573620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:51.573624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:51.573627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:51.573644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:51.573649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:51.573655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:51.573715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.573717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.573719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.573722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:51.573725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:51.573797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:51.573800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.573812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.573821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.573837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:51.573854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.573857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.573859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.573874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:51.573890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:51.573906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:51.573909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:51.573940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.573943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:51.574030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:51.574035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:51.574037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:51.574051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:51.574494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477453:2446], now have 1 active actors on pipe
2025-10-01T14:15:51.574502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477598:6332], now have 1 active actors on pipe
2025-10-01T14:15:51.574683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2649
2025-10-01T14:15:51.574718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2649
2025-10-01T14:15:51.574934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.574948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.574980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ea57548-2e731909-1df1d829-49cd65dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:51.574998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:51.575003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:51.575006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:51.575017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:51.575028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:51.575048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:51.575615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.575621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.575651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:51.576136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2650 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ea57548-2e731909-1df1d829-49cd65dc_0
2025-10-01T14:15:51.576460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4656a95-b5d98ba6-aea70cd2-105faa6d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ea57548-2e731909-1df1d829-49cd65dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:51.578972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Write session: try to update token
2025-10-01T14:15:51.578989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:51.610366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:51.610401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:51.610404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:51.610406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:51.610417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.610422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.610425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256873177555871:6512]
2025-10-01T14:15:51.610478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:51.610479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:51.610485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.610486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:51.610487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:51.610490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:51.610637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:51.613314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId: src_id|5ea57548-2e731909-1df1d829-49cd65dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:51.615926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:51.622328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256875554477706:5610]
2025-10-01T14:15:51.622601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2649, pipe: [1:7556256875554477706:5610]
2025-10-01T14:15:51.761548Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:51.761915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.761927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.761960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477706:5610], now have 1 active actors on pipe
2025-10-01T14:15:51.762097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:51.767767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:51.767819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:51.767900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2650 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ea57548-2e731909-1df1d829-49cd65dc_0
2025-10-01T14:15:51.768168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:51.768177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Write session will restart in 0.005906s
2025-10-01T14:15:51.768200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Write session: Do CDS request
2025-10-01T14:15:51.768206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:51.768072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2650 sessionId: src_id|5ea57548-2e731909-1df1d829-49cd65dc_0 is DEAD
2025-10-01T14:15:51.768241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256875554477706:5610]
2025-10-01T14:15:51.775755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:51.776057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:51.776071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2651
2025-10-01T14:15:51.776182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:51.776217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:51.776222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:51.776225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:51.776577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2651 sessionId:  describe result for acl check
2025-10-01T14:15:51.776600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:51.776602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:51.776603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:51.776607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256875554477742:6352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:51.777087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256875554477742:6352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:51.783478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256875554477742:6352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:51.791247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256875554477742:6352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:51.791263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256875554477742:6352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:51.791267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256875554477742:6352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:51.791275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:51.808371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:51.808962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:51.809141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:51.809150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:51.809160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:51.809205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:51.809242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256873177556129:6510]
2025-10-01T14:15:51.809827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:51.810794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:51.810851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:51.811163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:51.811546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.811547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.811549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.811550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.811551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.811552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.811553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.811554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.811555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.811556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.811557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.811558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.811559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.811561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.811568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.811578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.811581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.811585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.811588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.811592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.811595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.811599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.811603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.811606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.811610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.811614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.811617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.811621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.811629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.811636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:51.811642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.811648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:51.811652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.811657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:51.811660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.811665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:51.811669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.811673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:51.811678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.811681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:51.811685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.811689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:51.811692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.811696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:51.811701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.811705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:51.811709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.811714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.811717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.811721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.811725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.811729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.811735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.811739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:51.811742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.811746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:51.811781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:51.817419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:51.818040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:51.818045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:51.818047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:51.818051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:51.818057Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2650 [2:7556256873177556129:6510]
2025-10-01T14:15:51.818073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:51.818092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:51.818095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:51.818099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:51.818101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:51.818118Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:51.818124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:51.818130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:51.818186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.818189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.818191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.818194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:51.818197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:51.818257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:51.818258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.818266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:51.818272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:51.818281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:51.818293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.818294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.818297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.818311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:51.818324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:51.818336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:51.818339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:51.818388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.818390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:51.818416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477866:6352], now have 1 active actors on pipe
2025-10-01T14:15:51.818419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477729:2446], now have 1 active actors on pipe
2025-10-01T14:15:51.818439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:51.818441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:51.818443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:51.818447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:51.819001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2650
2025-10-01T14:15:51.819042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2650
2025-10-01T14:15:51.819114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.819129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.819157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:51.819170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:51.819175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:51.819179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:51.819190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:51.819204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:51.819226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:51.819447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:51.819455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:51.819472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:51.819959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea57548-2e731909-1df1d829-49cd65dc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:51.822607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Write session: try to update token
2025-10-01T14:15:51.822627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:51.819603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2651 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0
2025-10-01T14:15:51.842305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:51.842324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:51.842327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:51.842329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:51.842340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.842345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.842350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256873177556124:6510]
2025-10-01T14:15:51.842404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:51.842410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:51.842418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:51.842418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:51.842426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:51.842428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:51.842595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:51.851915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId: src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:51.854637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:51.868445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256875554477981:5610]
2025-10-01T14:15:51.870566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2650, pipe: [1:7556256875554477981:5610]
2025-10-01T14:15:52.009589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:52.010183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.010192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.010240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256875554477981:5610], now have 1 active actors on pipe
2025-10-01T14:15:52.010835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:52.012211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:52.012225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Write session will restart in 0.009570s
2025-10-01T14:15:52.012258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Write session: Do CDS request
2025-10-01T14:15:52.012264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:52.011459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:52.011488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:52.011562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2651 reason: error at write: Disconnected sessionId: src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0
2025-10-01T14:15:52.011791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2651 sessionId: src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0 is DEAD
2025-10-01T14:15:52.011946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256875554477981:5610]
2025-10-01T14:15:52.011987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:52.023040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:52.023076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:52.023095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2652
2025-10-01T14:15:52.025066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:52.025116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:52.025130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:52.025135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:52.025776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2652 sessionId:  describe result for acl check
2025-10-01T14:15:52.025817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:52.025827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:52.025829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:52.025834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256879849445325:6370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:52.026343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256879849445325:6370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:52.042138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256879849445325:6370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:52.051834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256879849445325:6370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:52.051852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256879849445325:6370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:52.051855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256879849445325:6370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:52.051865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:52.060719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:52.064391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:52.064929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:52.064934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:52.064950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:52.065014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:52.065070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256877472523672:6500]
2025-10-01T14:15:52.065754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:52.066224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:52.066269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:52.066685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:52.066784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.066785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.066786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.066787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.066789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.066790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.066791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.066792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.066793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.066794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.066796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.066797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.066798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.066799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.066806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.066815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.066819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.066823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.066826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.066830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.066833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.066836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.066840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.066844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.066848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.066851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.066855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.066858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.066867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.066874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.066882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.066904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.066909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.066914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.066921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.066927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.066932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.066938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.066943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.066949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.066954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.066959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.066964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.066969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.066974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.066979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.066984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.066990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.066996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.067001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.067005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.067010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.067018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.067023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.067027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.067032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.067071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:52.074043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:52.075044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:52.075065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:52.075070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:52.075076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:52.075085Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2651 [2:7556256877472523672:6500]
2025-10-01T14:15:52.075106Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:52.075132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:52.075141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:52.075147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:52.075149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:52.075170Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:52.075176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:52.075184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:52.075264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.075273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.075276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.075279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:52.075282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:52.075373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:52.075382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.075398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.075408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.076213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2651
2025-10-01T14:15:52.076253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2651
2025-10-01T14:15:52.075429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:52.075456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.075458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.075460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.075486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:52.075505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:52.075520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:52.075524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:52.075569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.075572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:52.075724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:52.075726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:52.075728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:52.075733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:52.083011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445467:6370], now have 1 active actors on pipe
2025-10-01T14:15:52.083036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445285:2446], now have 1 active actors on pipe
2025-10-01T14:15:52.083064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.083087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.083132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaced98f-b5867c66-81916c52-7408273d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:52.083151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:52.083158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:52.083161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:52.083177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:52.083197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:52.083223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:52.087024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.087046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.087089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:52.087480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2652 partition: 0 MaxSeqNo: 45 sessionId: src_id|aaced98f-b5867c66-81916c52-7408273d_0
2025-10-01T14:15:52.087934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d184e6b-edd3d201-94632204-bb0e9d6b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aaced98f-b5867c66-81916c52-7408273d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:52.096406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Write session: try to update token
2025-10-01T14:15:52.096432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:52.118453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256879849445525:5610]
2025-10-01T14:15:52.122646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445525:5610], now have 1 active actors on pipe
2025-10-01T14:15:52.122747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2651, pipe: [1:7556256879849445525:5610]
2025-10-01T14:15:52.126569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:52.126585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:52.126587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:52.126590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:52.126599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.126603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.126607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256877472523666:6500]
2025-10-01T14:15:52.126657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:52.126669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.126672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:52.126847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:52.130213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:52.130227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:52.130233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:52.155949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId: src_id|aaced98f-b5867c66-81916c52-7408273d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:52.158929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:52.291641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:52.292285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.292297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.292940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:52.295077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:52.295128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:52.295194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2652 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aaced98f-b5867c66-81916c52-7408273d_0
2025-10-01T14:15:52.295374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2652 sessionId: src_id|aaced98f-b5867c66-81916c52-7408273d_0 is DEAD
2025-10-01T14:15:52.295491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256879849445525:5610]
2025-10-01T14:15:52.299339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:52.299354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Write session will restart in 0.006633s
2025-10-01T14:15:52.299382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Write session: Do CDS request
2025-10-01T14:15:52.299389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:52.306946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:52.311254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:52.311268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2653
2025-10-01T14:15:52.311473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:52.311501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:52.311507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:52.311510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:52.315826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2653 sessionId:  describe result for acl check
2025-10-01T14:15:52.315874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:52.315875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:52.315877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:52.315883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256879849445598:6379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:52.316545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256879849445598:6379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:52.320105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256879849445598:6379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:52.332262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256879849445598:6379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:52.332278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256879849445598:6379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:52.332281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256879849445598:6379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:52.332291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:52.394715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256879849445783:5610]
2025-10-01T14:15:52.395728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:52.399068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:52.399702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:52.399709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:52.399732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:52.399824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:52.399869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256877472523944:6490]
2025-10-01T14:15:52.400497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:52.402722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:52.402784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:52.403156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:52.403223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.403224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.403225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.403227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.403228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.403229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.403230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.403231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.403233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.403234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.403235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.403236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.403237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.403238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.403244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.403255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.403259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.403263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.403266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.403270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.403273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.403277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.403280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.403284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.403288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.403291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.403295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.403299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.403307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.403315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.403322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.403327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.403332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.403337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.403341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.403346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.403350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.403355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.403360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.403365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.403370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.403375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.403380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.403384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.403391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.403397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.403403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.403408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.403414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.403418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.403422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.403427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.403435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.403440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.403445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.403450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.403486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:52.415384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:52.416386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:52.416392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:52.416396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:52.416400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:52.416408Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2652 [2:7556256877472523944:6490]
2025-10-01T14:15:52.416426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:52.416445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:52.416449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:52.416453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:52.416455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:52.416475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:52.416481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:52.416487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:52.416581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.416583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.416586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.416589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:52.416593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:52.416681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:52.416683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.416697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.416707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.416721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:52.416743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.416746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.416748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.416763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:52.416781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:52.416795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:52.416798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:52.416845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.416848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:52.419408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2652
2025-10-01T14:15:52.419443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2652, pipe: [1:7556256879849445783:5610]
2025-10-01T14:15:52.419465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2652
2025-10-01T14:15:52.418681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:52.418687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:52.418690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:52.418694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445546:2446], now have 1 active actors on pipe
2025-10-01T14:15:52.418697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:52.418701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445783:5610], now have 1 active actors on pipe
2025-10-01T14:15:52.418704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445658:6379], now have 1 active actors on pipe
2025-10-01T14:15:52.421997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.422009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.422041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:52.422053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:52.422058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:52.422061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:52.422074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:52.422088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:52.422107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:52.422462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.422469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.422483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:52.422644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2653 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0
2025-10-01T14:15:52.425729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaced98f-b5867c66-81916c52-7408273d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:52.428511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Write session: try to update token
2025-10-01T14:15:52.428544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:52.454129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:52.454147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:52.454151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:52.454153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:52.454166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.454171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.454176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256877472523938:6490]
2025-10-01T14:15:52.454224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:52.454231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.454234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:52.454389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:52.458721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:52.458732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:52.458739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:52.462015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId: src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:52.464721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:52.707432Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:52.707875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.707887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.709411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:52.709422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Write session will restart in 0.008975s
2025-10-01T14:15:52.709447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Write session: Do CDS request
2025-10-01T14:15:52.709453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:52.708779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256879849445783:5610]
2025-10-01T14:15:52.708811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:52.708813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:52.708868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2653 reason: error at write: Disconnected sessionId: src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0
2025-10-01T14:15:52.709057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2653 sessionId: src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0 is DEAD
2025-10-01T14:15:52.709194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:52.710292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:52.722660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:52.723081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:52.723094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2654
2025-10-01T14:15:52.726517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:52.726560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:52.726567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:52.726571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:52.726922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2654 sessionId:  describe result for acl check
2025-10-01T14:15:52.726944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:52.726946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:52.726947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:52.726952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256879849445821:6400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:52.727412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256879849445821:6400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:52.735809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256879849445821:6400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:52.743148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256879849445821:6400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:52.743168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256879849445821:6400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:52.743171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256879849445821:6400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:52.743180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:52.782912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:52.789603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:52.789887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:52.789892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:52.789905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:52.789964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:52.790023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256877472524198:6486]
2025-10-01T14:15:52.790644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:52.791198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:52.791246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:52.791586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:52.791653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.791655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.791656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.791658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.791659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.791660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.791661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.791663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.791664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.791665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.791667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.791668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.791669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.791670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.791676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.791686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.791691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.791695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.791699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.791703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.791707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.791711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.791715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.791719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.791723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.791727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.791730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.791734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.791740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.791748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:52.791755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.791760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:52.791765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.791771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:52.791775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.791780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:52.791786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.791791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:52.791795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.791800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:52.791805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.791810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:52.791815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.791820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:52.791827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.791832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:52.791836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.791841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.791846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.791852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.791855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.791861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.791865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.791870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:52.791874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.791880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:52.791919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:52.810510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256879849446049:5610]
2025-10-01T14:15:52.826349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:52.827015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:52.827022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:52.827025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:52.827028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:52.827035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2653 [2:7556256877472524198:6486]
2025-10-01T14:15:52.827052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:52.827068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:52.827071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:52.827074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:52.827077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:52.827094Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:52.827100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:52.827106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:52.827168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.827171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.827173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.827176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:52.827181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:52.827253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:52.827255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.827267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:52.827278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:52.827295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:52.827312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.827315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.827316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.827333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:52.827347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:52.827362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:52.827365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:52.827406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.827409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:52.827763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:52.827769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:52.827771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:52.827776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:52.828674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2653
2025-10-01T14:15:52.828702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2653, pipe: [1:7556256879849446049:5610]
2025-10-01T14:15:52.828720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2653
2025-10-01T14:15:52.834637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2654 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0
2025-10-01T14:15:52.835032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ebf5a71-f93a218d-95ce9283-b762087b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:52.837612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Write session: try to update token
2025-10-01T14:15:52.837631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:52.830103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445908:6400], now have 1 active actors on pipe
2025-10-01T14:15:52.830117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849446049:5610], now have 1 active actors on pipe
2025-10-01T14:15:52.830120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256879849445807:2446], now have 1 active actors on pipe
2025-10-01T14:15:52.830139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.830145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.830187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:52.830197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:52.830203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:52.830205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:52.830217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:52.830231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:52.830252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:52.834411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:52.834420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:52.834492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:52.865837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:52.865861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:52.865866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:52.865868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:52.865883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.865890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.865898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256877472524192:6486]
2025-10-01T14:15:52.865963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:52.865975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:52.865978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:52.866255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:52.866787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:52.866800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:52.866806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:52.869370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId: src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:52.872001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:53.062902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:53.063731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.063746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.063965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:53.063977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:53.064041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2654 reason: error at write: Disconnected sessionId: src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0
2025-10-01T14:15:53.064226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2654 sessionId: src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0 is DEAD
2025-10-01T14:15:53.064133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:53.064348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:53.064352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256879849446049:5610]
2025-10-01T14:15:53.064648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:53.064655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Write session will restart in 0.009121s
2025-10-01T14:15:53.064680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Write session: Do CDS request
2025-10-01T14:15:53.064689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:53.075030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.075204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:53.075220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2655
2025-10-01T14:15:53.075370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.075414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:53.075419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:53.075422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:53.075785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2655 sessionId:  describe result for acl check
2025-10-01T14:15:53.075824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:53.075831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:53.075833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:53.075838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256884144413440:6416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:53.076317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256884144413440:6416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:53.079732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256884144413440:6416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:53.087282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256884144413440:6416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:53.087297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256884144413440:6416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:53.087301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256884144413440:6416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:53.087309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:53.088782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:53.091663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:53.092107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:53.092111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:53.092125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:53.092185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:53.092221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256881767491746:6473]
2025-10-01T14:15:53.092779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:53.094281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:53.094329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:53.094646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:53.094717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.094718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.094720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.094721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.094722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.094724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.094725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.094726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.094727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.094728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.094729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.094730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.094731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.094732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.094738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.094747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.094751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.094754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.094757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.094761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.094764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.094767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.094771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.094775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.094779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.094781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.094784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.094787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.094795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.094802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.094807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.094812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.094817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.094823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.094827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.094832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.094836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.094841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.094844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.094851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.094856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.094861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.094865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.094871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.094875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.094880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.094884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.094889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.094894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.094900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.094904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.094910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.094914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.094920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.094925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.094929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.094974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:53.099870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:53.100829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:53.100833Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:53.100836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:53.100839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:53.100845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2654 [2:7556256881767491746:6473]
2025-10-01T14:15:53.100869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:53.100886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:53.100889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.100893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.100895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.100909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:53.100915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:53.100920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:53.100975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.100977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.100979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.100983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:53.100986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:53.101050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:53.101053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.101064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.101074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.101089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:53.101106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.101108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.101110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.101122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:53.101135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:53.101148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:53.101150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:53.101179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.101183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:53.101304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:53.101306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:53.101308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:53.101313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:53.101861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2654
2025-10-01T14:15:53.101892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2654
2025-10-01T14:15:53.102084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413617:6416], now have 1 active actors on pipe
2025-10-01T14:15:53.102092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413383:2446], now have 1 active actors on pipe
2025-10-01T14:15:53.102107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.102112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.102144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|583c792c-f52f54c7-759f956e-87ed94f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:53.102151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.102157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.102159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:53.102169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.102180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:53.102194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.102486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.102498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.102512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.102629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2655 partition: 0 MaxSeqNo: 45 sessionId: src_id|583c792c-f52f54c7-759f956e-87ed94f0_0
2025-10-01T14:15:53.102970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7c0065e-642bb6d1-216a8d69-8e6d506d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|583c792c-f52f54c7-759f956e-87ed94f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:53.105426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Write session: try to update token
2025-10-01T14:15:53.105444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:53.119811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId: src_id|583c792c-f52f54c7-759f956e-87ed94f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:53.122236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:53.122485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.122508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.122548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:53.122646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:53.130045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:53.130063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:53.130066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:53.130068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:53.130078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.130083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.130086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256881767491741:6473]
2025-10-01T14:15:53.130134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:53.130136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:53.130142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:53.130146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:53.130146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.130148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:53.130288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:53.164355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256884144413632:5610]
2025-10-01T14:15:53.166598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2654, pipe: [1:7556256884144413632:5610]
2025-10-01T14:15:53.311672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:53.320607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.320630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.320818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.320878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.320941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.321006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.321364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.321370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.321446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.321506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.321574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.321640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.321684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.321687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.321757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.321849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.321907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.321965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.322002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.322005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.322071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.322129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.322186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.322243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.322281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.322284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.322344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.322786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.322880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.322939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.322979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.322982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.323056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.323115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.323178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.323238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.323279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.323282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.323350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.323406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.323471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.323534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.323575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.323578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.323647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.323707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.323768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.323831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.323871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.323873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.323938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.323994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.324056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.324117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.324159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.324161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.324228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.324285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.324346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.324409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.324469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.324471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.324581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413632:5610], now have 1 active actors on pipe
2025-10-01T14:15:53.325457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:53.325923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:53.325974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|583c792c-f52f54c7-759f956e-87ed94f0_0
2025-10-01T14:15:53.326172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2655 sessionId: src_id|583c792c-f52f54c7-759f956e-87ed94f0_0 is DEAD
2025-10-01T14:15:53.326334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256884144413632:5610]
2025-10-01T14:15:53.326348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:53.334482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:53.334497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Write session will restart in 0.007909s
2025-10-01T14:15:53.334527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Write session: Do CDS request
2025-10-01T14:15:53.334535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:53.343893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.344233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:53.344251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2656
2025-10-01T14:15:53.344356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.344389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:53.344395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:53.344399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:53.344826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2656 sessionId:  describe result for acl check
2025-10-01T14:15:53.344861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:53.344870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:53.344872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:53.344876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256884144413655:6428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:53.345350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256884144413655:6428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:53.348051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256884144413655:6428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:53.354953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256884144413655:6428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:53.354970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256884144413655:6428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:53.354973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256884144413655:6428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:53.354981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:53.376222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:53.379755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:53.379965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:53.379969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:53.379981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:53.380028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:53.380063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256881767492005:6460]
2025-10-01T14:15:53.380618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:53.381030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:53.381068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:53.381349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:53.381390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.381391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.381392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.381394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.381395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.381395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.381396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.381397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.381398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.381399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.381401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.381401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.381402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.381403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.381407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.381415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.381419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.381422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.381425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.381428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.381431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.381434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.381438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.381442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.381445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.381448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.381451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.381454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.381460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.381467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.381472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.381477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.381481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.381485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.381488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.381492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.381496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.381501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.381504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.381508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.381512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.381517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.381520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.381525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.381528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.381533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.381536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.381540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.381544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.381549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.381553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.381557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.381561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.381565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.381568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.381572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.381605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:53.387985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:53.388587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:53.388602Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:53.388605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:53.388608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:53.388614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2655 [2:7556256881767492005:6460]
2025-10-01T14:15:53.388629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:53.388645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:53.388652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.388655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.388657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.388672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:53.388682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:53.388691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:53.388745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.388751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.388753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.388756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:53.388759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:53.388972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2655
2025-10-01T14:15:53.389004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2655
2025-10-01T14:15:53.388823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:53.388831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.388843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.388853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.388869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:53.388887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413695:6428], now have 1 active actors on pipe
2025-10-01T14:15:53.388890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413647:2446], now have 1 active actors on pipe
2025-10-01T14:15:53.388898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.388901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.388903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.388914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:53.388927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:53.388940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:53.388943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:53.388973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.388975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:53.389142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:53.389144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:53.389146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:53.389152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:53.389308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.389313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.389340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e071b416-8afb3707-70af065b-4b925d7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:53.389347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.389351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.389354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:53.389363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.389372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:53.389385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.389929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2656 partition: 0 MaxSeqNo: 45 sessionId: src_id|e071b416-8afb3707-70af065b-4b925d7f_0
2025-10-01T14:15:53.389820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.389827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.389841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.390292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583c792c-f52f54c7-759f956e-87ed94f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e071b416-8afb3707-70af065b-4b925d7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:53.392992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Write session: try to update token
2025-10-01T14:15:53.393013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:53.417853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId: src_id|e071b416-8afb3707-70af065b-4b925d7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:53.420427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:53.422598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.422619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.424598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:53.424629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:53.424632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:53.424634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:53.424636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:53.424645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.424649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.424653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256881767492000:6460]
2025-10-01T14:15:53.424699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:53.424705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.424707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:53.424836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:53.426541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:53.426552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:53.426555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:53.426701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256884144413897:5610]
2025-10-01T14:15:53.426738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:53.428762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2655, pipe: [1:7556256884144413897:5610]
2025-10-01T14:15:53.581514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:53.582217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413897:5610], now have 1 active actors on pipe
2025-10-01T14:15:53.589903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.589932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.590086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.590138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.590197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.590256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.590295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.590299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.590362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.590503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.590575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.590678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.590717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.590721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.590783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.590839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.590899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.590986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.591031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.591035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.591097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.591154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.591214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.591276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.591316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.591319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.591384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.591442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.591498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.591555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.591597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.591600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.591675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.591736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.591797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.591858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.591918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.591926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.591994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.592058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.592125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.592188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.592246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.592249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.592318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.592379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.592440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.592505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.592559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.592562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.592635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.592694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.592755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.592819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.592863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.592865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.592935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:53.592996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:53.593057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:53.593118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:53.593162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:53.593165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:53.594582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256884144413897:5610]
2025-10-01T14:15:53.594616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:53.594618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:53.594645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2656 reason: error at write: Disconnected sessionId: src_id|e071b416-8afb3707-70af065b-4b925d7f_0
2025-10-01T14:15:53.594843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2656 sessionId: src_id|e071b416-8afb3707-70af065b-4b925d7f_0 is DEAD
2025-10-01T14:15:53.594959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:53.594768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:53.602406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:53.602420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Write session will restart in 0.006572s
2025-10-01T14:15:53.602459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Write session: Do CDS request
2025-10-01T14:15:53.602466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:53.610812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.611400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:53.611419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2657
2025-10-01T14:15:53.611545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.611576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:53.611585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:53.611588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:53.614597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2657 sessionId:  describe result for acl check
2025-10-01T14:15:53.614635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:53.614637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:53.614639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:53.614644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256884144413928:6433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:53.615155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256884144413928:6433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:53.619541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256884144413928:6433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:53.622883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256884144413928:6433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:53.622900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256884144413928:6433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:53.622903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256884144413928:6433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:53.622912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:53.628435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:53.631057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:53.631290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:53.631299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:53.631310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:53.631369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:53.631643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256881767492264:6436]
2025-10-01T14:15:53.632244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:53.632692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:53.632737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:53.633043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:53.633093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.633094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.633095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.633096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.633098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.633099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.633100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.633101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.633102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.633103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.633104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.633105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.633106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.633107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.633113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.633124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.633128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.633132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.633135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.633139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.633143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.633147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.633151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.633155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.633158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.633162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.633165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.633169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.633175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.633183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.633190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.633196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.633200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.633205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.633210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.633215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.633220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.633226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.633231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.633236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.633241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.633246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.633250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.633255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.633260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.633266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.633272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.633278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.633285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.633289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.633293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.633297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.633301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.633305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.633309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.633314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.633348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:53.638233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:53.638897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:53.638903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:53.638906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:53.638910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:53.638918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2656 [2:7556256881767492264:6436]
2025-10-01T14:15:53.638936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:53.638955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:53.638959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.638963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.638966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.638982Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:53.638989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:53.638996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:53.639056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.639058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.639061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.639064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:53.639067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:53.639144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:53.639147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.639158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.639168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.639183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:53.639200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.639204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.639206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.639219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:53.639233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:53.639246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:53.639249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:53.639283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.639285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:53.639536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:53.639543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:53.639545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:53.639551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:53.640286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144414080:6433], now have 1 active actors on pipe
2025-10-01T14:15:53.640293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144413903:2446], now have 1 active actors on pipe
2025-10-01T14:15:53.640704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.640716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.640743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:53.640751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.640756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.640760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:53.640770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.640782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:53.640798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.641082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.641088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.641102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.642782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e071b416-8afb3707-70af065b-4b925d7f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:53.645384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Write session: try to update token
2025-10-01T14:15:53.645401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:53.640221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2656
2025-10-01T14:15:53.640251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2656
2025-10-01T14:15:53.641231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2657 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0
2025-10-01T14:15:53.675535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId: src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:53.678135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:53.674765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:53.674781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:53.674783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:53.674785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:53.674795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.674800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.674806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256881767492259:6436]
2025-10-01T14:15:53.674853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:53.674860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.674862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:53.675052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:53.678442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:53.678448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:53.678452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:53.697211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256884144414160:5610]
2025-10-01T14:15:53.698959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2656, pipe: [1:7556256884144414160:5610]
2025-10-01T14:15:53.854050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:53.854491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.854500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.854544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144414160:5610], now have 1 active actors on pipe
2025-10-01T14:15:53.855275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:53.855286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:53.855342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2657 reason: error at write: Disconnected sessionId: src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0
2025-10-01T14:15:53.855523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2657 sessionId: src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0 is DEAD
2025-10-01T14:15:53.855642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:53.855675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256884144414160:5610]
2025-10-01T14:15:53.856195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:53.857590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:53.857602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Write session will restart in 0.006104s
2025-10-01T14:15:53.857629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Write session: Do CDS request
2025-10-01T14:15:53.857636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:53.866854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.866979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:53.866993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2658
2025-10-01T14:15:53.867258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:53.867302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:53.867308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:53.867312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:53.867816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2658 sessionId:  describe result for acl check
2025-10-01T14:15:53.867843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:53.867845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:53.867847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:53.867861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256884144414187:6440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:53.868388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256884144414187:6440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:53.872948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256884144414187:6440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:53.879768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256884144414187:6440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:53.879786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256884144414187:6440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:53.879789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256884144414187:6440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:53.879798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:53.887084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:53.889792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:53.889998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:53.890002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:53.890016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:53.890068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:53.890101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256881767492524:6429]
2025-10-01T14:15:53.890653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:53.891071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:53.891114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:53.891392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:53.891444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.891445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.891446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.891447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.891448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.891449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.891450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.891451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.891452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.891453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.891454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.891456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.891457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.891458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.891464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.891473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.891477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.891481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.891485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.891489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.891492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.891496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.891499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.891502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.891506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.891509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.891513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.891517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.891523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.891530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:53.891536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.891542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:53.891547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.891551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:53.891555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.891560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:53.891565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.891570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:53.891574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.891579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:53.891585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.891590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:53.891595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.891599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:53.891604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.891609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:53.891612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.891616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.891620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.891624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.891627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.891631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.891635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.891639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:53.891643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.891647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:53.891682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:53.903088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:53.903868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:53.903873Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:53.903875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:53.903878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:53.903883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2657 [2:7556256881767492524:6429]
2025-10-01T14:15:53.903894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:53.903909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:53.903911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.903913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.903915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.903929Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:53.903932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:53.903936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:53.903979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.903980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.903981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.903984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:53.903986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:53.904043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:53.904045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.904054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:53.904061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:53.904069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:53.904082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.904083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.904085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.904094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:53.904105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:53.904118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:53.904120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:53.904158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.904160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:53.904347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:53.904351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:53.904353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:53.904356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:53.904668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2657
2025-10-01T14:15:53.904696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2657
2025-10-01T14:15:53.904761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144414333:6440], now have 1 active actors on pipe
2025-10-01T14:15:53.904769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144414163:2446], now have 1 active actors on pipe
2025-10-01T14:15:53.914436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.914453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.914485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|818cb84b-c557cf32-8772a39d-e5324182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:53.914497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:53.914503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:53.914506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:53.914518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:53.914534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:53.914554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.917415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.917429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.917472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:53.917641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2658 partition: 0 MaxSeqNo: 45 sessionId: src_id|818cb84b-c557cf32-8772a39d-e5324182_0
2025-10-01T14:15:53.918054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4506ab8-79a2a314-a0625d5c-ed5cadbe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|818cb84b-c557cf32-8772a39d-e5324182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:53.920591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Write session: try to update token
2025-10-01T14:15:53.920610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:53.954976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256884144414435:5610]
2025-10-01T14:15:53.955297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256884144414435:5610], now have 1 active actors on pipe
2025-10-01T14:15:53.955353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2657, pipe: [1:7556256884144414435:5610]
2025-10-01T14:15:53.959100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId: src_id|818cb84b-c557cf32-8772a39d-e5324182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:53.961814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:53.962221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:53.962245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:53.962289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:53.962409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:53.967181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:53.967198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:53.967201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:53.967203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:53.967212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.967216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.967221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256881767492516:6429]
2025-10-01T14:15:53.967266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:53.967272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:53.967275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:53.967420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:53.968489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:53.968496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:53.968501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:54.138155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:54.146355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.146399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.146572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.146629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.146688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.146755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.146800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.146805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.146876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.146934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.146998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.147065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.147109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.147112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.147175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.147229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.147285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.147345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.147380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.147383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.147443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.147628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.147684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.147741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.147778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.147781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.147844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.147899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.147956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.148014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.148054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.148057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.148131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.148199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.148257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.148314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.148361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.148363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.148428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.148485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.148561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.148618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.148656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.148661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.148732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.148790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.148850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.148909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.148948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.148952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.149018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.149075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.149131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.149189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.149308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.149311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.149378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.149434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.149497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.149557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.149597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.149600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.151717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:54.154461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:54.154513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256884144414435:5610]
2025-10-01T14:15:54.154535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:54.154572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2658 reason: status is not ok: tablet will be restarted right now sessionId: src_id|818cb84b-c557cf32-8772a39d-e5324182_0
2025-10-01T14:15:54.154733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2658 sessionId: src_id|818cb84b-c557cf32-8772a39d-e5324182_0 is DEAD
2025-10-01T14:15:54.158467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:54.158478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Write session will restart in 0.007652s
2025-10-01T14:15:54.158503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Write session: Do CDS request
2025-10-01T14:15:54.158509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:54.167997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:54.174685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:54.174701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2659
2025-10-01T14:15:54.174895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:54.174924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:54.174928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:54.174932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:54.175288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2659 sessionId:  describe result for acl check
2025-10-01T14:15:54.175312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:54.175316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:54.175318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:54.175323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256888439381755:6469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:54.175843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256888439381755:6469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:54.199672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256888439381755:6469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:54.203964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256888439381755:6469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:54.203983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256888439381755:6469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:54.203988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256888439381755:6469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:54.204001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:54.209317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:54.216480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:54.216731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:54.216735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:54.216745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:54.216797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:54.216837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256886062460074:6417]
2025-10-01T14:15:54.217772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:54.221449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:54.221517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:54.221854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:54.221912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.221913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.221914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.221915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.221917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.221918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.221919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.221920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.221921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.221923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.221924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.221925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.221926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.221926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.221933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.221941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.221944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.221947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.221951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.221954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.221958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.221961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.221965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.221968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.221971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.221975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.221978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.221981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.221989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.221997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.222002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.222007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.222011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.222015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.222019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.222023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.222027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.222031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.222035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.222039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.222044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.222049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.222053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.222057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.222062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.222066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.222071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.222076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.222080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.222085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.222089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.222093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.222097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.222102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.222108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.222113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.222148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:54.226305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:54.227197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:54.227202Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:54.227204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:54.227207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:54.227214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2658 [2:7556256886062460074:6417]
2025-10-01T14:15:54.227229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:54.227243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:54.227246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.227250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.227252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.227266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:54.227273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:54.227279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:54.227332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.227334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.227336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.227339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:54.227341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:54.227406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:54.227408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.227418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.227428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.227442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:54.227458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.227460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.227462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.227475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:54.227488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:54.227500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:54.227503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:54.227530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.227532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:54.228134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2658
2025-10-01T14:15:54.228171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2658
2025-10-01T14:15:54.227766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:54.227771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:54.227772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:54.227777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:54.228648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439381944:6469], now have 1 active actors on pipe
2025-10-01T14:15:54.228656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439381740:2446], now have 1 active actors on pipe
2025-10-01T14:15:54.228669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.228674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.228702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|944cf4e3-86bf8305-551be51c-d4c48913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:54.228709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.228714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.228717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:54.228726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.228735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:54.228749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:54.229112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.229117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.229131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:54.229645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818cb84b-c557cf32-8772a39d-e5324182_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|944cf4e3-86bf8305-551be51c-d4c48913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:54.232040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Write session: try to update token
2025-10-01T14:15:54.232058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:54.229255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2659 partition: 0 MaxSeqNo: 45 sessionId: src_id|944cf4e3-86bf8305-551be51c-d4c48913_0
2025-10-01T14:15:54.252629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:54.252646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:54.252649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:54.252650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:54.252659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.252664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.252668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256886062460069:6417]
2025-10-01T14:15:54.252712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:54.252718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.252720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:54.252854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:54.254878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:54.254887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:54.254891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:54.260547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256888439382004:5610]
2025-10-01T14:15:54.260842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2658, pipe: [1:7556256888439382004:5610]
2025-10-01T14:15:54.276073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId: src_id|944cf4e3-86bf8305-551be51c-d4c48913_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:54.278881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:54.415742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:54.416171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382004:5610], now have 1 active actors on pipe
2025-10-01T14:15:54.416228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.416239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.416440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:54.416558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:54.416571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:54.416630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2659 reason: error at write: Disconnected sessionId: src_id|944cf4e3-86bf8305-551be51c-d4c48913_0
2025-10-01T14:15:54.416785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2659 sessionId: src_id|944cf4e3-86bf8305-551be51c-d4c48913_0 is DEAD
2025-10-01T14:15:54.416905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:54.416918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256888439382004:5610]
2025-10-01T14:15:54.417251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:54.417259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Write session will restart in 0.006028s
2025-10-01T14:15:54.417285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Write session: Do CDS request
2025-10-01T14:15:54.417291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:54.424927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:54.425245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:54.425258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2660
2025-10-01T14:15:54.425409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:54.425432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:54.425437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:54.425440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:54.425884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2660 sessionId:  describe result for acl check
2025-10-01T14:15:54.425909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:54.425911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:54.425912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:54.425916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256888439382016:6471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:54.426357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256888439382016:6471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:54.428562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256888439382016:6471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:54.431077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256888439382016:6471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:54.431087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256888439382016:6471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:54.431090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256888439382016:6471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:54.431097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:54.455634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:54.457870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:54.458031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:54.458038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:54.458045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:54.458076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:54.458105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256886062460335:6405]
2025-10-01T14:15:54.458538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:54.458879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:54.458912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:54.459130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:54.459165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.459165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.459166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.459167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.459167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.459169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.459169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.459170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.459171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.459172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.459172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.459173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.459174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.459174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.459178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.459184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.459187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.459190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.459192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.459195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.459197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.459199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.459201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.459204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.459206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.459208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.459210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.459212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.459217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.459222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.459227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.459230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.459233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.459236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.459239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.459242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.459244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.459247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.459249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.459252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.459255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.459258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.459261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.459263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.459266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.459269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.459272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.459275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.459278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.459281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.459283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.459286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.459288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.459291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.459294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.459296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.459319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:54.463568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:54.464186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:54.464201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:54.464203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:54.464207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:54.464214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2659 [2:7556256886062460335:6405]
2025-10-01T14:15:54.464231Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:54.464248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:54.464255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.464259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.464261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.464279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:54.464287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:54.464300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:54.464354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.464359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.464360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.464364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:54.464366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:54.464429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:54.464435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.464444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.464453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.464466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:54.464483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.464485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.464487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.464495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:54.464499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:54.464501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:54.464503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:54.464509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:54.464533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:54.464536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:54.464548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382056:6471], now have 1 active actors on pipe
2025-10-01T14:15:54.464552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382007:2446], now have 1 active actors on pipe
2025-10-01T14:15:54.464587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.464595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:54.464933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2659
2025-10-01T14:15:54.464963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2659
2025-10-01T14:15:54.465071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:54.465210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.465216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.465244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:54.465253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.465259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.465262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:54.465274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.465287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:54.465307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:54.465634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.465640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.465658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:54.465745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2660 partition: 0 MaxSeqNo: 45 sessionId: src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0
2025-10-01T14:15:54.466147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944cf4e3-86bf8305-551be51c-d4c48913_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:54.468935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Write session: try to update token
2025-10-01T14:15:54.468955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:54.501182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId: src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:54.503577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:54.502978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:15:54.502998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:54.503007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.503049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:15:54.503215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:15:54.503346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:54.503469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:54.503609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:15:54.503751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:15:54.503785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:15:54.503828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.503837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.503855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:15:54.504269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:54.504523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:54.516663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256888439382262:5610]
2025-10-01T14:15:54.516964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382262:5610], now have 1 active actors on pipe
2025-10-01T14:15:54.517014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2659, pipe: [1:7556256888439382262:5610]
2025-10-01T14:15:54.533871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.533898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.535182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.535249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.535312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.535371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.535426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.535432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.535500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.535555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.535613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.535675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.535716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.535720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.535784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.535857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.535917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.535978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.536029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.536032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.536098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.536157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.536222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.536276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.536318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.536321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.536390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.536452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.536509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.536581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.536625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.536629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.536700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.536756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.536819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.536879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.536923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.536926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.536997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.537055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.537142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.537204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.537261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.537264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.537331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.537389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.537451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.537510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.537560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.537563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.537634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.537690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.537752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.537816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.537857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.537860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.537929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:54.537985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:54.538043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:54.538102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:54.538149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:54.538151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:54.538222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:15:54.538288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.538309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.538312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:15:54.538333Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538343Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538348Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538353Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538357Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538862Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538877Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538883Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538887Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.538890Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539285Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539298Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539304Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539308Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539311Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539316Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539320Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539324Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539330Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539340Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539524Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539534Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539538Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539543Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539547Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539551Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539555Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539559Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539563Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539569Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539680Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539691Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539695Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539699Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539704Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:15:54.539794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:15:54.539810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:15:54.539817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:15:54.539820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:15:54.539824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:15:54.540224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:15:54.540250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:15:54.540257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:15:54.540260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:15:54.540266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:15:54.540275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:15:54.540773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:15:54.540797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:15:54.540807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:15:54.540811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:15:54.540820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:15:54.540823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:15:54.541275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:15:54.541296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.541404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759328154538
2025-10-01T14:15:54.542465Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:15:54.542487Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:15:54.558018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:54.558034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:54.558038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:54.558040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:54.558050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.558054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.558057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256886062460330:6405]
2025-10-01T14:15:54.558099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:54.558108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:54.558108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:54.558114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:54.558115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.558118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:54.558257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:54.716043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:54.716995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:54.718972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:54.719041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2660 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0
2025-10-01T14:15:54.719233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2660 sessionId: src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0 is DEAD
2025-10-01T14:15:54.719365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256888439382262:5610]
2025-10-01T14:15:54.719385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:54.720264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:54.720275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Write session will restart in 0.007964s
2025-10-01T14:15:54.720302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Write session: Do CDS request
2025-10-01T14:15:54.720307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:54.730999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:54.731651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:54.731664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2661
2025-10-01T14:15:54.734803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:54.734845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:54.734850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:54.734854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:54.739052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2661 sessionId:  describe result for acl check
2025-10-01T14:15:54.739090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:54.739092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:54.739094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:54.739100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256888439382301:6501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:54.739609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256888439382301:6501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:54.745504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256888439382301:6501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:54.751699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256888439382301:6501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:54.751715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256888439382301:6501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:54.751718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256888439382301:6501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:54.751727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:54.763146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:54.766956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:54.767187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:54.767192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:54.767204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:54.767261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:54.767298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256886062460614:6400]
2025-10-01T14:15:54.767901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:54.768497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:54.768560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:54.768890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:54.768953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.768955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.768956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.768958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.768960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.768962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.768963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.768965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.768966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.768967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.768969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.768970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.768971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.768972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.768978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.768987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.768991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.768995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.768999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.769002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.769006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.769010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.769014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.769020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.769024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.769027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.769030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.769034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.769042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.769049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:54.769056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.769061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:54.769065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.769071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:54.769074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.769080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:54.769086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.769091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:54.769095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.769100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:54.769104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.769109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:54.769113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.769119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:54.769124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.769128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:54.769132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.769137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.769140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.769145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.769149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.769155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.769158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.769163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:54.769168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.769174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:54.769213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:54.776489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:54.777093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:54.777098Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:54.777100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:54.777104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:54.777111Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2660 [2:7556256886062460614:6400]
2025-10-01T14:15:54.777129Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:54.777147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:54.777150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.777154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.777157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.777172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:54.777178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:54.777184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:54.777244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.777246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.777248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.777251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:54.777253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:54.777319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:54.777322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.777334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:54.777344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:54.777360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:54.777376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.777379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.777381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.777394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:54.777407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:54.777422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:54.777425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:54.777457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.777460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:54.777669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:54.777673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:54.777676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:54.777680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:54.778050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2660
2025-10-01T14:15:54.778092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2660
2025-10-01T14:15:54.778562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382276:2446], now have 1 active actors on pipe
2025-10-01T14:15:54.778574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382417:6501], now have 1 active actors on pipe
2025-10-01T14:15:54.778602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.778608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.778635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:54.778643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:54.778649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:54.778652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:54.778661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:54.778674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:54.778688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:54.781753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2661 partition: 0 MaxSeqNo: 45 sessionId: src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0
2025-10-01T14:15:54.782268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2effeac6-d5ee4292-24c89d9e-a2d7350f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:54.781590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:54.781603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:54.781628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:54.784906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Write session: try to update token
2025-10-01T14:15:54.784923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:54.806909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:54.806922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:54.806924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:54.806926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:54.806936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.806941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.806945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256886062460608:6400]
2025-10-01T14:15:54.806990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:54.806997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:54.806999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:54.807136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:54.810855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:54.810867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:54.810871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:54.822574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256888439382531:5610]
2025-10-01T14:15:54.823982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId: src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:54.826564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:54.828391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2660, pipe: [1:7556256888439382531:5610]
2025-10-01T14:15:55.233797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:55.258978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.258999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.259022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256888439382531:5610], now have 1 active actors on pipe
2025-10-01T14:15:55.259262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:55.260552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:55.260565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Write session will restart in 0.007153s
2025-10-01T14:15:55.260594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Write session: Do CDS request
2025-10-01T14:15:55.260601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:55.260113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256888439382531:5610]
2025-10-01T14:15:55.260139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:55.260174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:55.260236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2661 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0
2025-10-01T14:15:55.260414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2661 sessionId: src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0 is DEAD
2025-10-01T14:15:55.268926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:55.269159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:55.269177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2662
2025-10-01T14:15:55.269319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:55.269352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:55.269357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:55.269360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:55.269790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2662 sessionId:  describe result for acl check
2025-10-01T14:15:55.269826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:55.269829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:55.269830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:55.269835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256892734349886:6518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:55.270324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256892734349886:6518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:55.273297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256892734349886:6518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:55.276914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256892734349886:6518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:55.276927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256892734349886:6518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:55.276930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256892734349886:6518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:55.276939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:55.314748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:55.315524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:55.315695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:55.315700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:55.315709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:55.315744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:55.315777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256890357428174:6379]
2025-10-01T14:15:55.316389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:55.316733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:55.316764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:55.317045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:55.317083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.317084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.317085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.317086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.317087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.317088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.317089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.317090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.317092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.317093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.317094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.317095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.317096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.317097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.317102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.317109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.317113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.317116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.317122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.317125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.317128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.317131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.317135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.317138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.317141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.317144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.317147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.317153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.317159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.317165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.317169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.317173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.317177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.317181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.317185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.317189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.317193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.317196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.317200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.317205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.317208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.317212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.317216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.317221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.317225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.317228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.317232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.317235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.317239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.317243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.317247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.317250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.317255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.317258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.317264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.317299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:55.321464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:55.322446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:55.322450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:55.322453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:55.322456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:55.322463Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2661 [2:7556256890357428174:6379]
2025-10-01T14:15:55.322478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:55.322495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:55.322498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:55.322502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:55.322504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:55.322519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:55.322525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:55.322530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:55.322587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.322589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.322592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.322595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:55.322597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:55.322661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:55.322664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.322674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.322684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.322699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:55.322715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.322717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.322719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.322730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:55.322743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:55.322759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:55.322762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:55.322791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.322793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:55.323113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:55.323119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:55.323121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:55.323126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:55.323738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2661
2025-10-01T14:15:55.323771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2661
2025-10-01T14:15:55.326525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734349877:2446], now have 1 active actors on pipe
2025-10-01T14:15:55.326541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734349926:6518], now have 1 active actors on pipe
2025-10-01T14:15:55.326571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.326578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.326609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:55.326620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:55.326625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:55.326628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:55.326641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:55.326657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:55.326676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:55.333911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2662 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0
2025-10-01T14:15:55.334476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee7573e-7f62bc96-bc1eda72-5cfbb1ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:55.330939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.330961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.331001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:55.337162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Write session: try to update token
2025-10-01T14:15:55.337184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:55.360293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256892734350132:5610]
2025-10-01T14:15:55.361189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2661, pipe: [1:7556256892734350132:5610]
2025-10-01T14:15:55.364282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId: src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:55.361038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734350132:5610], now have 1 active actors on pipe
2025-10-01T14:15:55.366610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:55.367875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.367894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.367931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:55.370398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:55.370411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:55.370413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:55.370415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:55.370425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.370430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.370434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256890357428169:6379]
2025-10-01T14:15:55.370479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:55.370486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.370488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:55.370616Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:55.370800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:55.370805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:55.370809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:55.372884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:55.583816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:55.604113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.604138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.604305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.604357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.604415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.604491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.604543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.604548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.604615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.604667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.604723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.604780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.604817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.604820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.604879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.604935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.604987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.605042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.605076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.605079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.605138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.605189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.605240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.605293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.605328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.605331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.605387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.605435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.605489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.605538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.605575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.605578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.605640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.605693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.605748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.605810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.605857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.605861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.605937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.606005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.606074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.606146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.606190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.606192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.606257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.606308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.606365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.606719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.606764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.606767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.606832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.606896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.606962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.607017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.607057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.607059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.607121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.607173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.607225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.607279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.607319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.607321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.613590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:55.617646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:55.617706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256892734350132:5610]
2025-10-01T14:15:55.617726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:55.617771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2662 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0
2025-10-01T14:15:55.617942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2662 sessionId: src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0 is DEAD
2025-10-01T14:15:55.620038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:55.620050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Write session will restart in 0.005804s
2025-10-01T14:15:55.620153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Write session: Do CDS request
2025-10-01T14:15:55.620159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:55.630967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:55.633445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:55.633462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2663
2025-10-01T14:15:55.634069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:55.634104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:55.634109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:55.634112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:55.634633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2663 sessionId:  describe result for acl check
2025-10-01T14:15:55.634674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:55.634676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:55.634680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:55.634685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256892734350150:6527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:55.635190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256892734350150:6527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:55.638312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256892734350150:6527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:55.655051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256892734350150:6527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:55.655069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256892734350150:6527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:55.655072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256892734350150:6527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:55.655080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:55.688117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:55.697819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:55.698055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:55.698059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:55.698071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:55.698124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:55.698159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256890357428456:6367]
2025-10-01T14:15:55.698741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:55.699178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:55.699222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:55.699503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:55.699560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.699562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.699563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.699564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.699566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.699567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.699568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.699569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.699571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.699572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.699573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.699574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.699575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.699576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.699581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.699590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.699594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.699598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.699602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.699606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.699609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.699613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.699617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.699621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.699625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.699628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.699632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.699635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.699642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.699649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:55.699656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.699661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:55.699666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.699671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:55.699675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.699680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:55.699684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.699689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:55.699693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.699698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:55.699703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.699708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:55.699712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.699717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:55.699721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.699727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:55.699731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.699736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.699741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.699745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.699749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.699754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.699758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.699762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:55.699766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.699770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:55.699808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:55.711555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:55.712211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:55.712217Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:55.712219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:55.712223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:55.712230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2662 [2:7556256890357428456:6367]
2025-10-01T14:15:55.712246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:55.712264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:55.712268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:55.712271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:55.712274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:55.712291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:55.712297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:55.712304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:55.712366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.712379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.712381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.712384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:55.712387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:55.712457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:55.712460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.712472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:55.712481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:55.712496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:55.712525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.712528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.712530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.712540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:55.712553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:55.712567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:55.712570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:55.712606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.712608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:55.712706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:55.712710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:55.712712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:55.712716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:55.715613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734350145:2446], now have 1 active actors on pipe
2025-10-01T14:15:55.715624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734350192:6527], now have 1 active actors on pipe
2025-10-01T14:15:55.715648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.715653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.715682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:55.715690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:55.715695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:55.715698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:55.715709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:55.715723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:55.715740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:55.716078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.716083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.716096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:55.716613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab34c050-b04abd10-2ac12a9a-4e763293_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:55.713411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2662
2025-10-01T14:15:55.713447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2662
2025-10-01T14:15:55.716219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2663 partition: 0 MaxSeqNo: 45 sessionId: src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0
2025-10-01T14:15:55.719021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Write session: try to update token
2025-10-01T14:15:55.719035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:55.721726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256892734350400:5610]
2025-10-01T14:15:55.722034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734350400:5610], now have 1 active actors on pipe
2025-10-01T14:15:55.722166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2662, pipe: [1:7556256892734350400:5610]
2025-10-01T14:15:55.751710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId: src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:55.754031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:55.754323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.754341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.754385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:55.757403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:55.768245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:55.768264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:55.768267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:55.768269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:55.768278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.768282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.768286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256890357428450:6367]
2025-10-01T14:15:55.768327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:55.768334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:55.768337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:55.768463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:55.769751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:55.769759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:55.769762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:55.951166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:55.959703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:55.959731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:55.959913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.959977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.960043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.960109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.960155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.960159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.960235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.960295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.960354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.960416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.960468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.960472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.960546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.960600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.960658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.960713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.960751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.960753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.960812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.960869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.960924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.960981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.961020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.961023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.961083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.961140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.961197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.961257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.961296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.961299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.961367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.961429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.961488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.961549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.961592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.961595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.961659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.961715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.961776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.961836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.961882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.961885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.961954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.962012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.962071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.962127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.962165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.962169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.962235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.962293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.962352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.962625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.962672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.962675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.962741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:55.962802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:55.962860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:55.964537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:55.964594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256892734350400:5610]
2025-10-01T14:15:55.964615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:55.964619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:55.964643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2663 reason: error at write: Disconnected sessionId: src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0
2025-10-01T14:15:55.964822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2663 sessionId: src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0 is DEAD
2025-10-01T14:15:55.962920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:55.962970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:55.962975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:55.964902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:55.965800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:55.965811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Write session will restart in 0.008517s
2025-10-01T14:15:55.965838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Write session: Do CDS request
2025-10-01T14:15:55.965845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:55.978879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:55.982702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:55.982716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2664
2025-10-01T14:15:55.983140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:55.983171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:55.983179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:55.983182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:55.984212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2664 sessionId:  describe result for acl check
2025-10-01T14:15:55.984238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:55.984240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:55.984241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:55.984249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256892734350443:6532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:55.984788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256892734350443:6532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:55.993691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256892734350443:6532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:56.006591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:56.006218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256892734350443:6532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:56.006237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256892734350443:6532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:56.006240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256892734350443:6532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:56.006249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:56.010720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:56.010962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:56.010966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:56.010978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:56.011035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:56.011070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256894652396018:6363]
2025-10-01T14:15:56.011610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:56.012153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:56.012198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:56.012496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:56.012577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.012578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.012579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.012580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.012581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.012582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.012583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.012584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.012585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.012586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.012587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.012588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.012589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.012590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.012596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.012605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.012608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.012612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.012615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.012618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.012621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.012625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.012628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.012632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.012635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.012638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.012641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.012644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.012651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.012658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.012667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.012671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.012676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.012680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.012683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.012688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.012692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.012696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.012700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.012704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.012708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.012712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.012716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.012720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.012724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.012728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.012733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.012736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.012740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.012744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.012749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.012753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.012757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.012761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.012764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.012768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.012815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:56.017313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:56.018034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:56.018040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:56.018042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:56.018046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:56.018052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2663 [2:7556256894652396018:6363]
2025-10-01T14:15:56.018066Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:56.018080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:56.018083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.018086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.018089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.018103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:56.018109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:56.018115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:56.018166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.018169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.018170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.018174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:56.018176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:56.018245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:56.018248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.018259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.018271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.018286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:56.018302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.018304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.018306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.018317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:56.018332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:56.018348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:56.018350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:56.018388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.018390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:56.019164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2663
2025-10-01T14:15:56.019191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2663
2025-10-01T14:15:56.018591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:56.018596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:56.018597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:56.018601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:56.022617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029317960:6532], now have 1 active actors on pipe
2025-10-01T14:15:56.022629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256892734350409:2446], now have 1 active actors on pipe
2025-10-01T14:15:56.022647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.022653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.022696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:56.022706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.022712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.022715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:56.022724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.022737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:56.022754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.023094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.023100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.023114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.023246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2664 partition: 0 MaxSeqNo: 45 sessionId: src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0
2025-10-01T14:15:56.023660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180f92d2-6d3d4a2d-542bf7fa-e0e45324_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:56.026145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Write session: try to update token
2025-10-01T14:15:56.026164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:56.055286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId: src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:56.058094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:56.057245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:56.057262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:56.057265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:56.057266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:56.057275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.057280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.057286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256894652396011:6363]
2025-10-01T14:15:56.057331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:56.057337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.057340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:56.057529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:56.058416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:56.058424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:56.058428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:56.063648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256897029317983:5610]
2025-10-01T14:15:56.064083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2663, pipe: [1:7556256897029317983:5610]
2025-10-01T14:15:56.228550Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:56.228948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.228959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.229398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:56.229451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256897029317983:5610]
2025-10-01T14:15:56.229469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:56.229471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:56.229521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2664 reason: error at write: Disconnected sessionId: src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0
2025-10-01T14:15:56.229688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2664 sessionId: src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0 is DEAD
2025-10-01T14:15:56.228984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029317983:5610], now have 1 active actors on pipe
2025-10-01T14:15:56.229965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:56.234594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:56.234606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Write session will restart in 0.009009s
2025-10-01T14:15:56.234632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Write session: Do CDS request
2025-10-01T14:15:56.234639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:56.249459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:56.249771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:56.249791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2665
2025-10-01T14:15:56.249966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:56.250002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:56.250007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:56.250010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:56.250520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2665 sessionId:  describe result for acl check
2025-10-01T14:15:56.250559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:56.250561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:56.250562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:56.250568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256897029318016:6564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:56.251100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256897029318016:6564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:56.266447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256897029318016:6564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:56.273534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256897029318016:6564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:56.273554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256897029318016:6564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:56.273557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256897029318016:6564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:56.273567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:56.298132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:56.300814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:56.300998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:56.301002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:56.301012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:56.301048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:56.301085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256894652396278:6355]
2025-10-01T14:15:56.301713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:56.302018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:56.302048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:56.302329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:56.302366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.302380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.302382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.302383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.302384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.302385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.302386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.302387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.302388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.302389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.302390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.302391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.302392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.302393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.302398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.302407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.302411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.302414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.302418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.302421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.302425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.302428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.302432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.302436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.302439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.302443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.302446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.302450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.302458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.302465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.302470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.302475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.302479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.302484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.302488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.302493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.302498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.302503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.302507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.302512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.302517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.302521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.302525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.302530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.302534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.302539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.302543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.302547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.302552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.302556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.302560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.302565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.302569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.302574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.302579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.302583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.302622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:56.306758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:56.307339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:56.307343Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:56.307346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:56.307349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:56.307356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2664 [2:7556256894652396278:6355]
2025-10-01T14:15:56.307370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:56.307385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:56.307388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.307391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.307393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.307407Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:56.307412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:56.307418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:56.307467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.307468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.307470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.307474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:56.307477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:56.307536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:56.307538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.307549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.307560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.307575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:56.307590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.307593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.307595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.307606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:56.307618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:56.307631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:56.307634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:56.307660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.307662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:56.307938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:56.307944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:56.307946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:56.307950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:56.308772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318000:2446], now have 1 active actors on pipe
2025-10-01T14:15:56.308779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318094:6564], now have 1 active actors on pipe
2025-10-01T14:15:56.308795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.308800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.308822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:56.308830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.308834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.308836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:56.308845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.308853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:56.308866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.308436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2664
2025-10-01T14:15:56.308469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2664
2025-10-01T14:15:56.309312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.309318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.309332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.309819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed94909-9f8eb443-e6f17095-2fc4f4e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:56.309454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2665 partition: 0 MaxSeqNo: 45 sessionId: src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0
2025-10-01T14:15:56.312170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Write session: try to update token
2025-10-01T14:15:56.312185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:56.329488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256897029318258:5610]
2025-10-01T14:15:56.329517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId: src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:56.331624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:56.332419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.332436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.332468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:56.332863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:56.333026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2664, pipe: [1:7556256897029318258:5610]
2025-10-01T14:15:56.333886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318258:5610], now have 1 active actors on pipe
2025-10-01T14:15:56.341293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:56.341310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:56.341312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:56.341314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:56.341321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.341325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.341329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256894652396273:6355]
2025-10-01T14:15:56.341372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:56.341378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.341379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:56.341495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:56.341559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:56.341566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:56.341569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:56.512191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:56.522634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.526538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:56.522657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.526584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:56.526586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:56.526610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2665 reason: error at write: Disconnected sessionId: src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0
2025-10-01T14:15:56.522826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.522882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.522939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.523006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.523398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.523403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.523472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.523529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.523585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.523649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.523687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.523690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.523750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.523801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.523861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.523914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.523950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.523952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.524012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.524068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.524120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.524176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.524213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.524216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.524275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.524329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.524383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.524439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.524475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.524477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.524557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.524614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.524681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.524740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.524780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.524784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.524846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.524899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.524959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.525019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.525057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.525060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.525129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.525181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.525233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.525285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.525321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.525322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.525389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.525438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.525488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.525539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.525573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.525575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.525637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:56.525685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:56.525738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:56.525786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:56.525821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:56.525822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:56.526293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:56.526768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2665 sessionId: src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0 is DEAD
2025-10-01T14:15:56.526866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256897029318258:5610]
2025-10-01T14:15:56.530596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:56.530613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Write session will restart in 0.009704s
2025-10-01T14:15:56.530640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Write session: Do CDS request
2025-10-01T14:15:56.530646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:56.548393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:56.550633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:56.550647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2666
2025-10-01T14:15:56.550815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:56.550842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:56.550848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:56.550850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:56.551483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2666 sessionId:  describe result for acl check
2025-10-01T14:15:56.551521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:56.551523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:56.551525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:56.551530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256897029318289:6562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:56.552046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256897029318289:6562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:56.564683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256897029318289:6562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:56.579340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256897029318289:6562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:56.579358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256897029318289:6562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:56.579361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256897029318289:6562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:56.579370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:56.587082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:56.589848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:56.590051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:56.590055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:56.590066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:56.590118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:56.590151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256894652396546:6356]
2025-10-01T14:15:56.590727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:56.591158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:56.591200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:56.591502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:56.591560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.591561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.591562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.591563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.591564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.591565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.591566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.591567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.591568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.591569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.591570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.591572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.591573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.591574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.591579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.591588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.591591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.591595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.591599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.591603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.591607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.591610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.591613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.591617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.591620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.591624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.591627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.591631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.591638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.591645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.591652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.591657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.591661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.591665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.591669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.591673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.591677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.591682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.591685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.591690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.591694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.591699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.591703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.591708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.591713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.591718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.591722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.591727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.591731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.591736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.591740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.591744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.591748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.591753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.591757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.591761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.591797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:56.596331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:56.597126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:56.597130Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:56.597132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:56.597136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:56.597142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2665 [2:7556256894652396546:6356]
2025-10-01T14:15:56.597156Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:56.597171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:56.597174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.597177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.597179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.597194Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:56.597199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:56.597205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:56.597261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.597263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.597265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.597268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:56.597271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:56.597335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:56.597337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.597348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.597359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.597374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:56.597391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.597393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.597395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.597409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:56.597422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:56.597435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:56.597439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:56.597469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.597472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:56.597732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:56.597739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:56.597741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:56.597746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:56.598361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2665
2025-10-01T14:15:56.598410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2665
2025-10-01T14:15:56.599016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318457:6562], now have 1 active actors on pipe
2025-10-01T14:15:56.599026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318264:2446], now have 1 active actors on pipe
2025-10-01T14:15:56.599040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.599046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.599074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6af1afd-90012f59-56412a34-4e03143_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:56.599085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.599090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.599092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:56.599103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.599115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:56.599141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.599728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.599737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.599755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.600363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95a0b9c-618a3ea9-e6d9d4d7-b3499ee8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c6af1afd-90012f59-56412a34-4e03143_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:56.599915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2666 partition: 0 MaxSeqNo: 45 sessionId: src_id|c6af1afd-90012f59-56412a34-4e03143_0
2025-10-01T14:15:56.603602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Write session: try to update token
2025-10-01T14:15:56.603621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:56.625117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:56.625136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:56.625139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:56.625141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:56.625149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.625153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.625157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256894652396541:6356]
2025-10-01T14:15:56.625203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:56.625210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.625212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:56.625354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:56.626506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:56.626516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:56.626519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:56.634454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256897029318527:5610]
2025-10-01T14:15:56.634988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2665, pipe: [1:7556256897029318527:5610]
2025-10-01T14:15:56.655897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId: src_id|c6af1afd-90012f59-56412a34-4e03143_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:56.658363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:56.796897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:56.797176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318527:5610], now have 1 active actors on pipe
2025-10-01T14:15:56.797224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.797230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.797635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:56.797565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256897029318527:5610]
2025-10-01T14:15:56.797595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:56.797597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:56.797642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2666 reason: error at write: Disconnected sessionId: src_id|c6af1afd-90012f59-56412a34-4e03143_0
2025-10-01T14:15:56.797820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2666 sessionId: src_id|c6af1afd-90012f59-56412a34-4e03143_0 is DEAD
2025-10-01T14:15:56.797927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:56.798521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:56.798532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Write session will restart in 0.006795s
2025-10-01T14:15:56.798563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Write session: Do CDS request
2025-10-01T14:15:56.798569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:56.807717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:56.810941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:56.810953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2667
2025-10-01T14:15:56.811288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:56.811315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:56.811320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:56.811323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:56.811794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2667 sessionId:  describe result for acl check
2025-10-01T14:15:56.811826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:56.811828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:56.811829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:56.811834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256897029318549:6576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:56.812315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256897029318549:6576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:56.821291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256897029318549:6576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:56.834673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256897029318549:6576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:56.834691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256897029318549:6576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:56.834695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256897029318549:6576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:56.834704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:56.863019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:56.870058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:56.870309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:56.870320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:56.870332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:56.870404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:56.870444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256894652396829:6335]
2025-10-01T14:15:56.872436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:56.874921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:56.874974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:56.875450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:56.875497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.875499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.875500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.875501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.875502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.875503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.875505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.875506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.875507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.875508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.875509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.875510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.875511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.875513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.875519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.875527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.875531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.875534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.875538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.875541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.875544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.875548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.875551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.875554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.875557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.875561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.875564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.875567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.875574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.875581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:56.875587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.875593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:56.875597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.875601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:56.875605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.875609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:56.875613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.875617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:56.875621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.875625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:56.875630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.875634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:56.875637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.875641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:56.875645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.875650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:56.875654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.875659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.875666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.875670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.875673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.875678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.875682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.875686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:56.875690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.875694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:56.875726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:56.883532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:56.884215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:56.884219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:56.884222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:56.884225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:56.884232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2666 [2:7556256894652396829:6335]
2025-10-01T14:15:56.884248Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:56.884263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:56.884266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.884270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.884272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.884286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:56.884292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:56.884298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:56.884349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.884351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.884354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.884357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:56.884359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:56.884428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:56.884430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.884439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:56.884449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:56.884462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:56.884477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.884479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.884481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.884489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:56.884500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:56.884523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:56.884526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:56.884641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.884643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:56.884777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:56.884779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:56.884780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:56.884785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:56.885162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318535:2446], now have 1 active actors on pipe
2025-10-01T14:15:56.885168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318655:6576], now have 1 active actors on pipe
2025-10-01T14:15:56.890426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2666
2025-10-01T14:15:56.890467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2666
2025-10-01T14:15:56.891919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.891933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.891965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41aea711-850c55a6-37bcedd8-57f38a44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:56.891976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:56.891981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:56.891984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:56.891995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:56.892009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:56.892028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.896015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:56.896028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:56.896061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:56.896257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2667 partition: 0 MaxSeqNo: 45 sessionId: src_id|41aea711-850c55a6-37bcedd8-57f38a44_0
2025-10-01T14:15:56.899585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6af1afd-90012f59-56412a34-4e03143_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41aea711-850c55a6-37bcedd8-57f38a44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:56.902479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Write session: try to update token
2025-10-01T14:15:56.902496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:56.902421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256897029318795:5610]
2025-10-01T14:15:56.908321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256897029318795:5610], now have 1 active actors on pipe
2025-10-01T14:15:56.908955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2666, pipe: [1:7556256897029318795:5610]
2025-10-01T14:15:56.919953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:56.919970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:56.919972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:56.919974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:56.919983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.919988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.919991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256894652396824:6335]
2025-10-01T14:15:56.920035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:56.920041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:56.920043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:56.920173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:56.923004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:56.923013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:56.923016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:56.940549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId: src_id|41aea711-850c55a6-37bcedd8-57f38a44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:56.943159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:57.109751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:57.109998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.110005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.110482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:57.113230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:57.113249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Write session will restart in 0.007592s
2025-10-01T14:15:57.113273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Write session: Do CDS request
2025-10-01T14:15:57.113279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:57.112799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256897029318795:5610]
2025-10-01T14:15:57.112822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:57.112848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:57.112908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41aea711-850c55a6-37bcedd8-57f38a44_0
2025-10-01T14:15:57.113088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2667 sessionId: src_id|41aea711-850c55a6-37bcedd8-57f38a44_0 is DEAD
2025-10-01T14:15:57.122081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:57.122312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:57.122324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2668
2025-10-01T14:15:57.122465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:57.122492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:57.122497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:57.122500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:57.123122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2668 sessionId:  describe result for acl check
2025-10-01T14:15:57.123147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:57.123149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:57.123150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:57.123155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256901324286143:6602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:57.123603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256901324286143:6602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:57.130745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256901324286143:6602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:57.145619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256901324286143:6602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:57.145633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256901324286143:6602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:57.145636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256901324286143:6602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:57.145643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:57.161778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:57.165365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:57.165665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:57.165676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:57.165688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:57.165746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:57.165784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256898947364388:6332]
2025-10-01T14:15:57.166339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:57.166726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:57.166766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:57.167054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:57.167105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.167106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.167107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.167109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.167110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.167111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.167112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.167113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.167114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.167116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.167117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.167118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.167119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.167120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.167125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.167134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.167137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.167142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.167145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.167149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.167153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.167156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.167159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.167163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.167166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.167170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.167174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.167177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.167185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.167192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.167198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.167203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.167207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.167211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.167216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.167220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.167227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.167231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.167236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.167240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.167244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.167249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.167253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.167258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.167262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.167268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.167272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.167277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.167281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.167286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.167290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.167294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.167298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.167303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.167307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.167311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.167346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:57.176969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2667
2025-10-01T14:15:57.177006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2667
2025-10-01T14:15:57.174865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:57.175845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:57.175850Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:57.175852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:57.175855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:57.175862Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2667 [2:7556256898947364388:6332]
2025-10-01T14:15:57.175877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:57.175894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:57.175897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:57.175900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:57.175902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:57.175919Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:57.175930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:57.175938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:57.175994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.175996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.175998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.176001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:57.176003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:57.176070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:57.176072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.176084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.176095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.176111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:57.176127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.176130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.176131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.176144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:57.176157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:57.176171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:57.176174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:57.176220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.176222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:57.176299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:57.176301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:57.176302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:57.176307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:57.179771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286121:2446], now have 1 active actors on pipe
2025-10-01T14:15:57.179782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286274:6602], now have 1 active actors on pipe
2025-10-01T14:15:57.179802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.179808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.179835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:57.179843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:57.179847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:57.179850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:57.179859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:57.179872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:57.179888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:57.180200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.180206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.180219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:57.180350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2668 partition: 0 MaxSeqNo: 45 sessionId: src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0
2025-10-01T14:15:57.180755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41aea711-850c55a6-37bcedd8-57f38a44_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:57.183232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Write session: try to update token
2025-10-01T14:15:57.183248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:57.210325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId: src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:57.212583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:57.212662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256901324286392:5610]
2025-10-01T14:15:57.213107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.213127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.213147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286392:5610], now have 1 active actors on pipe
2025-10-01T14:15:57.213170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:57.213268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2667, pipe: [1:7556256901324286392:5610]
2025-10-01T14:15:57.213298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:57.226419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:57.226434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:57.226437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:57.226438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:57.226448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.226453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.226457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256898947364382:6332]
2025-10-01T14:15:57.226499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:57.226507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.226510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:57.226655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:57.226662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:57.226668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:57.226671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:57.489860Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:57.498577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.498603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.498775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.498841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.498903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.498965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.499329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.499343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.499412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.499466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.499524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.499583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.499622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.499625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.499686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.499739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.499793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.499850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.499886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.499888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.499951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.500005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.500056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.500110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.500151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.500153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.500302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.500353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.500402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.500478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.500531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.500534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.500604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.500662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.500723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.500780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.500822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.500826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.500891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.500950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.501009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.501067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.501347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.501351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.501413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.501469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.501531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.501586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.501643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.501646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.501709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.501767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.501826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.501888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.501929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.501931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.501997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:57.502054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:57.502108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:57.502167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:57.502207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:57.502210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:57.503011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:57.507827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:57.507838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Write session will restart in 0.008916s
2025-10-01T14:15:57.507861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Write session: Do CDS request
2025-10-01T14:15:57.507867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:57.507431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:57.507495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:57.507536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2668 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0
2025-10-01T14:15:57.507706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2668 sessionId: src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0 is DEAD
2025-10-01T14:15:57.507840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256901324286392:5610]
2025-10-01T14:15:57.520887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:57.521464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:57.521476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2669
2025-10-01T14:15:57.521656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:57.521682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:57.521687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:57.521690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:57.522120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2669 sessionId:  describe result for acl check
2025-10-01T14:15:57.522149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:57.522151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:57.522152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:57.522156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256901324286423:6613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:57.522635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256901324286423:6613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:57.545605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256901324286423:6613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:57.555647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256901324286423:6613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:57.555664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256901324286423:6613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:57.555667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256901324286423:6613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:57.555682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:57.579243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:57.583260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:57.583486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:57.583490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:57.583501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:57.583541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:57.583574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256898947364649:6319]
2025-10-01T14:15:57.584193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:57.590565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:57.590630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:57.590963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:57.591016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.591018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.591019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.591020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.591021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.591022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.591023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.591024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.591025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.591026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.591028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.591029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.591030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.591031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.591037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.591046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.591049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.591053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.591056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.591060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.591063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.591066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.591069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.591073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.591076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.591079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.591081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.591085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.591094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.591102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.591108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.591113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.591117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.591121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.591125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.591129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.591135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.591139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.591143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.591147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.591153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.591159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.591164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.591168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.591171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.591176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.591179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.591183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.591187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.591191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.591194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.591198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.591202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.591206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.591210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.591214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.591246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:57.598838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:57.599732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:57.599737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:57.599739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:57.599742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:57.599748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2668 [2:7556256898947364649:6319]
2025-10-01T14:15:57.599762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:57.599778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:57.599780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:57.599783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:57.599785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:57.599800Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:57.599806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:57.599811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:57.599867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.599869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.599870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.599874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:57.599877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:57.599942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:57.599945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.599955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.599965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.599978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:57.599993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.599996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.599998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.600006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:57.600018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:57.600031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:57.600033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:57.600062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.600063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:57.600877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2668
2025-10-01T14:15:57.600904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2668
2025-10-01T14:15:57.600275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:57.600280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:57.600282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:57.600286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:57.606789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286578:6613], now have 1 active actors on pipe
2025-10-01T14:15:57.606801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286412:2446], now have 1 active actors on pipe
2025-10-01T14:15:57.606817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.606824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.606856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:57.606866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:57.606871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:57.606874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:57.606892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:57.606905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:57.606925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:57.607238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.607243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.607255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:57.607370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2669 partition: 0 MaxSeqNo: 45 sessionId: src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0
2025-10-01T14:15:57.607703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256901324286677:5610]
2025-10-01T14:15:57.608035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2668, pipe: [1:7556256901324286677:5610]
2025-10-01T14:15:57.608073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286677:5610], now have 1 active actors on pipe
2025-10-01T14:15:57.608996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6818cdb-21f348c7-254668d7-fccb2c07_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:57.611245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Write session: try to update token
2025-10-01T14:15:57.611264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:57.637138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:57.637155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:57.637158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:57.637160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:57.637171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.637175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.637179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256898947364643:6319]
2025-10-01T14:15:57.637232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:57.637238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.637241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:57.637384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:57.640576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:57.640591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:57.640598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:57.648537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId: src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:57.651220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:57.841369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:57.841664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.841675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.842802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:57.842814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Write session will restart in 0.005289s
2025-10-01T14:15:57.842838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Write session: Do CDS request
2025-10-01T14:15:57.842844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:57.842367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256901324286677:5610]
2025-10-01T14:15:57.842409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:57.842470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2669 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0
2025-10-01T14:15:57.842654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2669 sessionId: src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0 is DEAD
2025-10-01T14:15:57.842876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:57.841955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:57.848883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:57.848945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:57.848959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2670
2025-10-01T14:15:57.849133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:57.849162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:57.849168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:57.849171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:57.850607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2670 sessionId:  describe result for acl check
2025-10-01T14:15:57.850643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:57.850644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:57.850649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:57.850653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256901324286698:6627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:57.851108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256901324286698:6627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:57.854951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256901324286698:6627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:57.858832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256901324286698:6627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:57.858843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256901324286698:6627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:57.858847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256901324286698:6627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:57.858854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:57.880410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:57.883374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:57.883619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:57.883624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:57.883636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:57.883692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:57.883729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256898947364946:6307]
2025-10-01T14:15:57.884290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:57.884687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:57.884732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:57.885065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:57.885136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.885138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.885139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.885141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.885142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.885143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.885144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.885146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.885147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.885148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.885150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.885151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.885152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.885153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.885159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.885168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.885172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.885176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.885180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.885183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.885187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.885191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.885194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.885198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.885201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.885204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.885208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.885211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.885218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.885226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:57.885232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.885237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:57.885241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.885246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:57.885249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.885254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:57.885257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.885264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:57.885268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.885273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:57.885277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.885282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:57.885286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.885290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:57.885293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.885298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:57.885302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.885307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.885314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.885319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.885322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.885327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.885330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.885335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:57.885339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.885343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:57.885379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:57.889799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:57.891134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2669
2025-10-01T14:15:57.891166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2669
2025-10-01T14:15:57.890786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:57.890798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:57.890801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:57.890804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:57.890811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2669 [2:7556256898947364946:6307]
2025-10-01T14:15:57.890825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:57.890839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:57.890843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:57.890846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:57.890848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:57.890863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:57.890867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:57.890872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:57.890923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.890925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.890928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.890931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:57.890934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:57.890994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:57.890997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.891009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:57.891019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:57.891033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:57.891049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286736:6627], now have 1 active actors on pipe
2025-10-01T14:15:57.891052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286690:2446], now have 1 active actors on pipe
2025-10-01T14:15:57.891059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.891061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.891064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.891078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:57.891089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:57.891102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:57.891105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:57.891129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.891131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:57.891176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:57.891180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:57.891182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:57.891189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:57.891500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.891509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.891541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:57.891548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:57.891553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:57.891555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:57.891563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:57.891573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:57.891588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:57.891827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.891833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.891846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:57.892342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91267f0c-e98ee7aa-e6b496e5-7314a130_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:57.891938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2670 partition: 0 MaxSeqNo: 45 sessionId: src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0
2025-10-01T14:15:57.895055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Write session: try to update token
2025-10-01T14:15:57.895072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:57.909112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId: src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:57.911339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:57.911977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:57.912005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:57.912028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:57.912033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:57.912035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:57.912037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:57.912046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.912051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.912054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256898947364940:6307]
2025-10-01T14:15:57.912088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:57.912100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:57.912104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:57.912107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:57.912113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:57.912115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:57.912248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:57.942772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256901324286953:5610]
2025-10-01T14:15:57.946616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2669, pipe: [1:7556256901324286953:5610]
2025-10-01T14:15:58.060524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:58.060744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:58.060786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256901324286953:5610], now have 1 active actors on pipe
2025-10-01T14:15:58.062365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:58.063392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:58.063407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Write session will restart in 0.007352s
2025-10-01T14:15:58.063432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Write session: Do CDS request
2025-10-01T14:15:58.063439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:58.062470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:58.062477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:58.062546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2670 reason: error at write: Disconnected sessionId: src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0
2025-10-01T14:15:58.062668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2670 sessionId: src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0 is DEAD
2025-10-01T14:15:58.062866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256901324286953:5610]
2025-10-01T14:15:58.062881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:58.073564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:58.073807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:58.073824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2671
2025-10-01T14:15:58.074866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:58.074907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:58.074913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:58.074916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:58.075263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2671 sessionId:  describe result for acl check
2025-10-01T14:15:58.075288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:58.075290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:58.075292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:58.075296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256905619254269:6653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:58.075792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256905619254269:6653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:58.091042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256905619254269:6653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:58.107728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256905619254269:6653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:58.107746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256905619254269:6653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:58.107749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256905619254269:6653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:58.107757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:58.119557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:58.138147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:58.138437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:58.138443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:58.138458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:58.138534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:58.138573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256903242332503:6305]
2025-10-01T14:15:58.139282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:58.141138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:58.141193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:58.141552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:58.141691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.141692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.141694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.141695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.141696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.141698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.141699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.141700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.141702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.141703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.141704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.141706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.141707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.141709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.141716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.141725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.141729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.141734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.141738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.141742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.141745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.141749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.141753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.141757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.141760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.141764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.141769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.141771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.141780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.141788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.141795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.141800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.141805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.141810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.141814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.141820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.141825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.141830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.141834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.141839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.141844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.141849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.141857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.141862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.141867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.141872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.141877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.141882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.141889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.141897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.141901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.141907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.141911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.141917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.141921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.141926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.141963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:58.151133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:58.151738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:58.151743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:58.151745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:58.151748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:58.151753Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2670 [2:7556256903242332503:6305]
2025-10-01T14:15:58.151766Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:58.151781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:58.151783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:58.151785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:58.151787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:58.151801Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:58.151804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:58.151809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:58.151853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.151855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.151856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.151858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:58.151860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:58.151923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:58.151925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.151933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.151939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.151948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:58.151960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.151963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.151964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.151973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:58.151983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:58.151991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:58.151993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:58.152023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.152025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:58.152136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:58.152138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:58.152139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:58.152142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:58.152370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254254:2446], now have 1 active actors on pipe
2025-10-01T14:15:58.152372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254421:6653], now have 1 active actors on pipe
2025-10-01T14:15:58.152917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2670
2025-10-01T14:15:58.152957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2670
2025-10-01T14:15:58.157653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29c0a5e-6d11361f-7be477d-cfc527e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|36885b05-afd01bad-8a097e88-bad90311_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:58.157238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2671 partition: 0 MaxSeqNo: 45 sessionId: src_id|36885b05-afd01bad-8a097e88-bad90311_0
2025-10-01T14:15:58.160237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Write session: try to update token
2025-10-01T14:15:58.160252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:58.156313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.156330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.156363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36885b05-afd01bad-8a097e88-bad90311_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:58.156374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:58.156379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:58.156381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:58.156392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:58.156409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:58.156801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:58.157100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.157104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.157120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:58.166606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256905619254532:5610]
2025-10-01T14:15:58.166935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2670, pipe: [1:7556256905619254532:5610]
2025-10-01T14:15:58.167973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254532:5610], now have 1 active actors on pipe
2025-10-01T14:15:58.179182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:58.179203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:58.179206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:58.179208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:58.179217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.179223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.179227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256903242332497:6305]
2025-10-01T14:15:58.179276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:58.179283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.179286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:58.179421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:58.182726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:58.182740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:58.182743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:58.183442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId: src_id|36885b05-afd01bad-8a097e88-bad90311_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:58.186319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:58.343983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:58.344266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.344275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.344652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:58.345341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:58.345353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Write session will restart in 0.008575s
2025-10-01T14:15:58.345377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Write session: Do CDS request
2025-10-01T14:15:58.345383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:58.344916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:58.344965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256905619254532:5610]
2025-10-01T14:15:58.344983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:58.344986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:58.345037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2671 reason: error at write: Disconnected sessionId: src_id|36885b05-afd01bad-8a097e88-bad90311_0
2025-10-01T14:15:58.345210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2671 sessionId: src_id|36885b05-afd01bad-8a097e88-bad90311_0 is DEAD
2025-10-01T14:15:58.354949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:58.355090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:58.355104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2672
2025-10-01T14:15:58.355199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:58.355231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:58.355236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:58.355240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:58.355594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2672 sessionId:  describe result for acl check
2025-10-01T14:15:58.355619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:58.355621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:58.355622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:58.355627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256905619254586:6679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:58.356122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256905619254586:6679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:58.359742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256905619254586:6679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:58.364577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256905619254586:6679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:58.364593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256905619254586:6679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:58.364597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256905619254586:6679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:58.364604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:58.376094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:58.379588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:58.379816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:58.379825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:58.379838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:58.379889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:58.379951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256903242332769:6295]
2025-10-01T14:15:58.380551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:58.380870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:58.380916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:58.381221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:58.381275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.381276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.381277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.381278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.381280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.381281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.381282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.381283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.381284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.381285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.381287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.381288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.381289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.381290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.381295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.381305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.381308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.381312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.381315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.381319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.381323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.381327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.381331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.381335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.381339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.381342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.381346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.381350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.381357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.381364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.381372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.381377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.381382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.381387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.381392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.381396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.381401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.381405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.381409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.381413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.381418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.381434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.381438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.381443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.381448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.381452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.381456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.381461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.381465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.381470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.381474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.381479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.381483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.381489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.381493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.381497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.381536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:58.385814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:58.386851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:58.386863Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:58.386865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:58.386868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:58.386875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2671 [2:7556256903242332769:6295]
2025-10-01T14:15:58.386892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:58.386908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:58.386911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:58.386915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:58.386917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:58.386933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:58.386938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:58.386944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:58.387000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.387002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.387004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.387008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:58.387010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:58.387076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:58.387078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.387090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.387099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.387114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:58.387130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.387133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.387136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.387149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:58.387163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:58.387193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:58.387195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:58.387197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:58.387702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:58.387711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:58.387759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254723:6679], now have 1 active actors on pipe
2025-10-01T14:15:58.387762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254558:2446], now have 1 active actors on pipe
2025-10-01T14:15:58.387774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.387780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.387799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.387806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:58.387836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:58.387843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:58.387847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:58.387850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:58.387860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:58.387869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:58.387893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:58.388087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:58.388222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.388228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.388247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:58.389247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36885b05-afd01bad-8a097e88-bad90311_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:58.387424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2671
2025-10-01T14:15:58.387462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2671
2025-10-01T14:15:58.388424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2672 partition: 0 MaxSeqNo: 45 sessionId: src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0
2025-10-01T14:15:58.391744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Write session: try to update token
2025-10-01T14:15:58.391761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:58.420765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:58.420784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:58.420787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:58.420789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:58.420800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.420804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.420807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256903242332763:6295]
2025-10-01T14:15:58.420857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:58.420861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:58.420864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.420866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:58.420867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:58.420871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:58.420992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:58.424354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId: src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:58.426778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:58.445543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256905619254823:5610]
2025-10-01T14:15:58.445966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2671, pipe: [1:7556256905619254823:5610]
2025-10-01T14:15:58.736831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:58.737304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.737312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.737351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254823:5610], now have 1 active actors on pipe
2025-10-01T14:15:58.737779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:58.738861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256905619254823:5610]
2025-10-01T14:15:58.738885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:58.738911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:58.738967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2672 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0
2025-10-01T14:15:58.739134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2672 sessionId: src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0 is DEAD
2025-10-01T14:15:58.741731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:58.741742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Write session will restart in 0.008106s
2025-10-01T14:15:58.741770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Write session: Do CDS request
2025-10-01T14:15:58.741777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:58.752080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:58.754667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:58.754682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2673
2025-10-01T14:15:58.754857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:58.754884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:58.754889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:58.754892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:58.758818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2673 sessionId:  describe result for acl check
2025-10-01T14:15:58.758857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:58.758859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:58.758861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:58.758866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256905619254844:6699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:58.759483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256905619254844:6699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:58.772611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256905619254844:6699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:58.779597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256905619254844:6699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:58.779612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256905619254844:6699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:58.779614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256905619254844:6699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:58.779623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:58.827938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:58.831206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:58.831748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:58.831759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:58.831773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:58.831826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:58.831869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256903242333074:6279]
2025-10-01T14:15:58.832439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:58.832789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:58.832834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:58.833119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:58.833182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.833183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.833184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.833185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.833186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.833186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.833187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.833188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.833189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.833190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.833191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.833192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.833193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.833194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.833199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.833208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.833211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.833214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.833218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.833221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.833225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.833228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.833231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.833235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.833238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.833241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.833244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.833247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.833254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.833261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:58.833267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.833271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:58.833275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.833278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:58.833282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.833286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:58.833290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.833294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:58.833298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.833302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:58.833306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.833310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:58.833314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.833319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:58.833322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.833327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:58.833330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.833334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.833339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.833343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.833346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.833352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.833356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.833360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:58.833364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.833368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:58.833401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:58.837938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:58.838721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:58.838736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:58.838738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:58.838742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:58.838749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2672 [2:7556256903242333074:6279]
2025-10-01T14:15:58.838765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:58.838786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:58.838794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:58.838799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:58.838801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:58.838817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:58.838823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:58.838829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:58.838887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.838894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.838896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.838901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:58.838905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:58.839339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2672
2025-10-01T14:15:58.839369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2672
2025-10-01T14:15:58.838967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:58.838976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.838987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:58.838998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:58.839013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:58.839032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254882:6699], now have 1 active actors on pipe
2025-10-01T14:15:58.839036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619254836:2446], now have 1 active actors on pipe
2025-10-01T14:15:58.839043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.839045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.839047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.839060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:58.839075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:58.839088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:58.839090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:58.839118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.839120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:58.839201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:58.839203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:58.839205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:58.839209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:58.840029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.840039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.840070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:58.840079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:58.840083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:58.840085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:58.840095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:58.840105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:58.840122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:58.840450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.840455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.840467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:58.840615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2673 partition: 0 MaxSeqNo: 45 sessionId: src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0
2025-10-01T14:15:58.841059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6054ce04-967ee434-943cc1c6-9e6c60c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:58.843605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Write session: try to update token
2025-10-01T14:15:58.843623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:58.846661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256905619255100:5610]
2025-10-01T14:15:58.851321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256905619255100:5610], now have 1 active actors on pipe
2025-10-01T14:15:58.851363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2672, pipe: [1:7556256905619255100:5610]
2025-10-01T14:15:58.869126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId: src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:58.871908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:58.874848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:58.874870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:58.874909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:58.875230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:58.893795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:58.893815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:58.893818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:58.893820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:58.893830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.893834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.893837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256903242333068:6279]
2025-10-01T14:15:58.893885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:58.893892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:58.893895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:58.894038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:58.902984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:58.903001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:58.903006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:59.116011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:59.125420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.125446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.125603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.125654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.125705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.125772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.125811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.125814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.125875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.125928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.125981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.126034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.126222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.126226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.126279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.126325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.128978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:59.128991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:59.129022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2673 reason: error at write: Disconnected sessionId: src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0
2025-10-01T14:15:59.129205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2673 sessionId: src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0 is DEAD
2025-10-01T14:15:59.129349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:59.129358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Write session will restart in 0.008693s
2025-10-01T14:15:59.129356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:59.129384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Write session: Do CDS request
2025-10-01T14:15:59.129391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:59.126486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.126550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.126587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.126590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.126650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.126701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.126747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.126807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.126844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.126847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.126909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.126964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.127020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.127071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.127108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.127112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.127182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.127243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.127300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.127364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.127404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.127407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.127476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.127532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.127594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.127654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.127695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.127698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.127767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.127821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.127883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.127945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.127987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.127989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.128055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.128111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.128172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.128230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.128294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.128297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.128363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.128417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.128487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.128558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.128604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.128607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.129396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256905619255100:5610]
2025-10-01T14:15:59.130033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:59.139507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.142802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:59.142816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2674
2025-10-01T14:15:59.142999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.143026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:59.143030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:59.143033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:59.143658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2674 sessionId:  describe result for acl check
2025-10-01T14:15:59.143688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:59.143690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:59.143691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:59.143696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256909914222423:6702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:59.144160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256909914222423:6702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:59.152798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256909914222423:6702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:59.161507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256909914222423:6702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:59.161526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256909914222423:6702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:59.161529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256909914222423:6702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:59.161537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:59.172143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:59.179122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:59.179366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:59.179370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:59.179382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:59.179434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:59.179473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256907537300634:6269]
2025-10-01T14:15:59.179972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:59.180350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:59.180408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:59.180737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:59.180790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.180791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.180793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.180794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.180795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.180796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.180797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.180799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.180800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.180801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.180802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.180803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.180804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.180806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.180812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.180823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.180827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.180832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.180836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.180840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.180844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.180848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.180853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.180858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.180862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.180866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.180870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.180874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.180882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.180890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.180897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.180902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.180906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.180912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.180917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.180923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.180927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.180933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.180937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.180942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.180948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.180953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.180957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.180962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.180967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.180973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.180977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.180982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.180986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.180992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.180996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.181001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.181008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.181013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.181017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.181022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.181061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:59.189816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:59.190643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:59.190655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:59.190658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:59.190661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:59.190667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2673 [2:7556256907537300634:6269]
2025-10-01T14:15:59.190684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:59.190700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:59.190703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:59.190706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:59.190708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:59.190724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:59.190730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:59.190736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:59.190792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.190793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.190795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.190798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:59.190800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:59.190866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:59.190868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.190879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.190888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.190902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:59.190918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.190920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.190922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.190934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:59.190947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:59.190961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:59.190964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:59.190999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.191001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:59.191143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:59.191145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:59.191147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:59.191151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:59.191556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2673
2025-10-01T14:15:59.191591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2673
2025-10-01T14:15:59.192053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222526:6702], now have 1 active actors on pipe
2025-10-01T14:15:59.192067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222410:2446], now have 1 active actors on pipe
2025-10-01T14:15:59.192098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.192108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.192134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32c67071-660aa3a9-42812353-fe0456ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:59.192146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:59.192151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:59.192154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:59.192164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:59.192186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:59.192204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:59.192581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.192594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.192613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:59.192734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2674 partition: 0 MaxSeqNo: 45 sessionId: src_id|32c67071-660aa3a9-42812353-fe0456ac_0
2025-10-01T14:15:59.193091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73b8fd-94b912b1-4751c176-2197aa9d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32c67071-660aa3a9-42812353-fe0456ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:59.195599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Write session: try to update token
2025-10-01T14:15:59.195618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:59.214645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId: src_id|32c67071-660aa3a9-42812353-fe0456ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:59.216813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:59.216833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:59.216836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:59.216837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:59.216845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.216850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.216853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256907537300629:6269]
2025-10-01T14:15:59.216896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:59.216899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:59.216907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.216909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:59.216909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:59.216912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:59.216994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:59.217030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:59.229075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256909914222692:5610]
2025-10-01T14:15:59.230603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2673, pipe: [1:7556256909914222692:5610]
2025-10-01T14:15:59.376972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:59.377555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.377575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.377616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222692:5610], now have 1 active actors on pipe
2025-10-01T14:15:59.378514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:59.380200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256909914222692:5610]
2025-10-01T14:15:59.380223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:59.380255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:59.380317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2674 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32c67071-660aa3a9-42812353-fe0456ac_0
2025-10-01T14:15:59.380492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2674 sessionId: src_id|32c67071-660aa3a9-42812353-fe0456ac_0 is DEAD
2025-10-01T14:15:59.381225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:59.381236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Write session will restart in 0.007581s
2025-10-01T14:15:59.381264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Write session: Do CDS request
2025-10-01T14:15:59.381271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:59.390957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.392642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:59.392659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2675
2025-10-01T14:15:59.392822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.392868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:59.392879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:59.392883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:59.396288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2675 sessionId:  describe result for acl check
2025-10-01T14:15:59.396329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:59.396331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:59.396333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:59.396338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256909914222741:6726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:59.397261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256909914222741:6726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:59.407820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256909914222741:6726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:59.419506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256909914222741:6726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:59.419520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256909914222741:6726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:59.419523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256909914222741:6726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:59.419532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:59.444078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:59.446789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:59.446998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:59.447002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:59.447013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:59.447077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:59.447111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256907537300906:6255]
2025-10-01T14:15:59.447715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:59.449698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:59.449742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:59.450057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:59.450108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.450109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.450110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.450111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.450113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.450114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.450115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.450116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.450117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.450119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.450120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.450121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.450122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.450123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.450129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.450138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.450142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.450145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.450149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.450153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.450157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.450160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.450164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.450168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.450171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.450175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.450179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.450182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.450189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.450197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.450202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.450207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.450212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.450216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.450221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.450226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.450230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.450236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.450240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.450257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.450263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.450268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.450272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.450277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.450282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.450288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.450292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.450297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.450302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.450307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.450312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.450318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.450322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.450327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.450331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.450336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.450390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:59.457977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:59.458569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:59.458575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:59.458578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:59.458581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:59.458588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2674 [2:7556256907537300906:6255]
2025-10-01T14:15:59.458615Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:59.458633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:59.458636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:59.458640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:59.458642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:59.458659Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:59.458664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:59.458670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:59.458727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.458730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.458732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.458735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:59.458737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:59.458803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:59.458806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.458817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.458827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.458844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:59.458859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.458862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.458864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.458875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:59.458888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:59.458902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:59.458904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:59.458936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.458939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:59.459152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:59.459158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:59.459159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:59.459164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:59.459456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222716:2446], now have 1 active actors on pipe
2025-10-01T14:15:59.459462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222880:6726], now have 1 active actors on pipe
2025-10-01T14:15:59.459778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2674
2025-10-01T14:15:59.459823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2674
2025-10-01T14:15:59.460613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.460625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.460655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:59.460665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:59.460670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:59.460673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:59.460684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:59.460695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:59.460714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:59.463833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.463849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.463879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:59.464487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c67071-660aa3a9-42812353-fe0456ac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:59.467040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Write session: try to update token
2025-10-01T14:15:59.467058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:59.464067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2675 partition: 0 MaxSeqNo: 45 sessionId: src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0
2025-10-01T14:15:59.482485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256909914222983:5610]
2025-10-01T14:15:59.486244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222983:5610], now have 1 active actors on pipe
2025-10-01T14:15:59.486447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2674, pipe: [1:7556256909914222983:5610]
2025-10-01T14:15:59.499417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId: src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:59.501889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:59.502316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.502351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.502404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:15:59.502566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:59.512822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:59.512840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:59.512843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:59.512845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:59.512854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.512859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.512864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256907537300900:6255]
2025-10-01T14:15:59.512911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:59.512918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.512920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:59.513050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:59.513848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:59.513855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:59.513860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:59.676928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:59.687709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.687741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.687945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.688011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.688078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.688142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.688192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.688198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.688276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.688338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.688398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.688468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.688527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.688531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.688598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.688653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.688717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.688777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.688817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.688822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.688885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.688942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.688999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.689060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.689103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.689107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.689174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.689230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.689285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.689340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.689391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.689394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.689467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.689534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.689601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.689672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.689711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.689715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.689789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.689855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.689923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.689989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.690032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.690035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.690114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.690179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.690247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.690311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.690354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.690357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.690458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.690523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.690588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.690657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.690702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.690705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.690778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:15:59.690840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:15:59.690902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:15:59.690962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:15:59.696616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:15:59.696633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:15:59.698518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256909914222983:5610]
2025-10-01T14:15:59.698543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:59.698576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:15:59.698579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:15:59.698602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2675 reason: error at write: Disconnected sessionId: src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0
2025-10-01T14:15:59.698768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2675 sessionId: src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0 is DEAD
2025-10-01T14:15:59.698269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:59.699203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:15:59.699211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Write session will restart in 0.007095s
2025-10-01T14:15:59.699235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Write session: Do CDS request
2025-10-01T14:15:59.699242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:59.710856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.711301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:59.711314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2676
2025-10-01T14:15:59.711482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.711513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:59.711519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:59.711523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:59.712107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2676 sessionId:  describe result for acl check
2025-10-01T14:15:59.712141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:59.712143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:59.712148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:59.712153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256909914223012:6737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:59.712715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256909914223012:6737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:59.719894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256909914223012:6737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:59.730592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256909914223012:6737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:59.730607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256909914223012:6737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:59.730610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256909914223012:6737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:59.730620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:59.754113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:59.754358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:59.754543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:59.754555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:59.754563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:59.754599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:59.754627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256907537301170:6250]
2025-10-01T14:15:59.755042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:59.755538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:59.755565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:59.755763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:59.755793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.755793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.755794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.755795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.755795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.755796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.755797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.755797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.755798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.755798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.755799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.755800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.755800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.755801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.755804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.755809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.755812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.755814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.755816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.755818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.755820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.755822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.755824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.755827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.755829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.755831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.755833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.755835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.755839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.755844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.755848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.755851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.755853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.755858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.755862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.755866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.755870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.755875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.755878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.755887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.755892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.755896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.755898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.755901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.755903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.755906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.755908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.755910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.755913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.755915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.755917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.755921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.755924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.755927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.755931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.755933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.755954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:15:59.760912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:15:59.761752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:15:59.761762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:15:59.761764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:15:59.761768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:15:59.761774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2675 [2:7556256907537301170:6250]
2025-10-01T14:15:59.761789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:15:59.761807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:15:59.761809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:59.761812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:59.761814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:59.761830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:15:59.761835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:15:59.761841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:15:59.761893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.761895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.761897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.761901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:15:59.761904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:15:59.761965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:15:59.761967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.761978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.761987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.762002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:15:59.762018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.762020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.762023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.762035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:15:59.762050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:15:59.762063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:15:59.762066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:15:59.762097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.762100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:15:59.762189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:15:59.762191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:15:59.762192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:15:59.762196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:15:59.763491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914222995:2446], now have 1 active actors on pipe
2025-10-01T14:15:59.763499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914223126:6737], now have 1 active actors on pipe
2025-10-01T14:15:59.763517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.763522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.763551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:15:59.763560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:15:59.763564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:15:59.763566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:15:59.763575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:15:59.763588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:15:59.763603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:59.763984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.763993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.764009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:15:59.763086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2675
2025-10-01T14:15:59.763124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2675
2025-10-01T14:15:59.764120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2676 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0
2025-10-01T14:15:59.766546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6370019e-eb23acb8-b3bd5c33-fa641bc5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:15:59.769307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Write session: try to update token
2025-10-01T14:15:59.769326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:15:59.792323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:15:59.792339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:15:59.792342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:15:59.792344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:15:59.792354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.792358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.792362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256907537301164:6250]
2025-10-01T14:15:59.792415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:15:59.792421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.792424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:15:59.792428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:15:59.792435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:15:59.792440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:15:59.792590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:15:59.794114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId: src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:15:59.796694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:15:59.799811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256909914223267:5610]
2025-10-01T14:15:59.800162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2675, pipe: [1:7556256909914223267:5610]
2025-10-01T14:15:59.952173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:15:59.952450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:15:59.952466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:15:59.952488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914223267:5610], now have 1 active actors on pipe
2025-10-01T14:15:59.952708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:15:59.954466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:15:59.954479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Write session will restart in 0.009821s
2025-10-01T14:15:59.954504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Write session: Do CDS request
2025-10-01T14:15:59.954510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:15:59.953201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256909914223267:5610]
2025-10-01T14:15:59.953230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:15:59.953260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:15:59.953329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2676 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0
2025-10-01T14:15:59.953533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2676 sessionId: src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0 is DEAD
2025-10-01T14:15:59.965861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.966155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:15:59.966169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2677
2025-10-01T14:15:59.966321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:15:59.966349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:15:59.966354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:15:59.966358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:15:59.967074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2677 sessionId:  describe result for acl check
2025-10-01T14:15:59.967107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:15:59.967108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:15:59.967112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:15:59.967117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256909914223291:6753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:15:59.967596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256909914223291:6753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:15:59.975467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256909914223291:6753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:15:59.987350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256909914223291:6753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:15:59.987366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256909914223291:6753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:15:59.987370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256909914223291:6753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:15:59.987378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:15:59.991752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:15:59.994799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:15:59.995021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:15:59.995026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:15:59.995036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:15:59.995086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:15:59.995125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256907537301476:6235]
2025-10-01T14:15:59.995715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:15:59.996135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:15:59.996178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:15:59.996462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:15:59.996500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.996501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.996502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.996503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.996503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.996504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.996505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.996505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.996506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.996519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.996520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.996520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.996521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.996522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.996526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.996532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.996534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.996536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.996538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.996540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.996542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.996544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.996546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.996548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.996551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.996552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.996554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.996556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.996562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.996567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:15:59.996571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.996574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:15:59.996577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.996580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:15:59.996583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.996586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:15:59.996588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.996591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:15:59.996593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.996596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:15:59.996599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.996602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:15:59.996604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.996609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:15:59.996611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.996614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:15:59.996616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.996620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:15:59.996622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.996625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:15:59.996627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.996629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:15:59.996632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.996634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:15:59.996636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.996639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:15:59.996660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:00.000760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:00.001447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:00.001454Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:00.001456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:00.001460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:00.001466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2676 [2:7556256907537301476:6235]
2025-10-01T14:16:00.001483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:00.001501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:00.001504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.001508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.001510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.001527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:00.001534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:00.001540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:00.001601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.001603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.001605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.001608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:00.001611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:00.001684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:00.001687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.001698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.001709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.001725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:00.001743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.001746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.001749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.001757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:00.001772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:00.001784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:00.001787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:00.001817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.001820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:00.002175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:00.002181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:00.002183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:00.002192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:00.002979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2676
2025-10-01T14:16:00.003020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2676
2025-10-01T14:16:00.006841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914223272:2446], now have 1 active actors on pipe
2025-10-01T14:16:00.006855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256909914223514:6753], now have 1 active actors on pipe
2025-10-01T14:16:00.006881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.006887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.006920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:00.006932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.006938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.006941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:00.006954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.006970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:00.006992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:00.009764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.009779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.009812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:00.010759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2677 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0
2025-10-01T14:16:00.014722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2474a9-5f85130a-c8b13c64-cbce671c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:00.017624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Write session: try to update token
2025-10-01T14:16:00.017650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:00.037211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:00.037231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:00.037234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:00.037236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:00.037246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.037251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.037256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256907537301471:6235]
2025-10-01T14:16:00.037310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:00.037308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:00.037315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:00.037318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.037320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:00.037330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:00.037464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:00.041456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId: src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:00.043909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:00.054477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256914209190837:5610]
2025-10-01T14:16:00.062472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2676, pipe: [1:7556256914209190837:5610]
2025-10-01T14:16:00.365907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:00.366281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.366291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.366327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209190837:5610], now have 1 active actors on pipe
2025-10-01T14:16:00.367173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:00.367222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:00.367225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:00.367285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2677 reason: error at write: Disconnected sessionId: src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0
2025-10-01T14:16:00.367498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2677 sessionId: src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0 is DEAD
2025-10-01T14:16:00.367640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256914209190837:5610]
2025-10-01T14:16:00.370333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:00.370343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Write session will restart in 0.005006s
2025-10-01T14:16:00.370366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Write session: Do CDS request
2025-10-01T14:16:00.370388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:00.378275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:00.374776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:00.382578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:00.382591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2678
2025-10-01T14:16:00.390451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:00.390510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:00.390517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:00.390522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:00.391274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2678 sessionId:  describe result for acl check
2025-10-01T14:16:00.391300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:00.391301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:00.391303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:00.391306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256914209190905:6775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:00.391787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256914209190905:6775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:00.399721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256914209190905:6775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:00.405935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256914209190905:6775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:00.405951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256914209190905:6775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:00.405955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256914209190905:6775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:00.405963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:00.438845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:00.454224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:00.454519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:00.454524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:00.454537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:00.454600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:00.454645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256911832269049:6221]
2025-10-01T14:16:00.455271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:00.455788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:00.455836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:00.456152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:00.456206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.456207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.456208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.456209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.456210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.456212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.456214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.456215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.456216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.456218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.456219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.456220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.456221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.456222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.456228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.456239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.456243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.456247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.456251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.456256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.456259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.456263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.456267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.456273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.456277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.456280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.456284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.456287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.456295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.456304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.456309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.456315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.456319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.456324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.456329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.456334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.456342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.456347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.456352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.456356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.456361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.456366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.456370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.456374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.456378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.456384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.456388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.456394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.456399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.456404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.456410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.456415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.456420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.456424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.456429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.456433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.456473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:00.461387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:00.462200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:00.462207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:00.462210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:00.462214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:00.462222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2677 [2:7556256911832269049:6221]
2025-10-01T14:16:00.462239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:00.462258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:00.462263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.462266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.462269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.462289Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:00.462294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:00.462302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:00.462390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.462392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.462395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.462398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:00.462401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:00.462481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:00.462484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.462498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.462510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.462529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:00.462549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.462552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.462554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.462570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:00.462587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:00.462602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:00.462606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:00.462651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.462653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:00.462957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:00.462963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:00.462965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:00.462970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:00.463868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2677
2025-10-01T14:16:00.463925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2677
2025-10-01T14:16:00.463894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209190882:2446], now have 1 active actors on pipe
2025-10-01T14:16:00.463908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209190957:6775], now have 1 active actors on pipe
2025-10-01T14:16:00.464423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.464431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.464467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e39f1eb-65743556-beba0852-bdf3573e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:00.464481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.464489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.464492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:00.464526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.464545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:00.464571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:00.464936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.464951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.464974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:00.465167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2678 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e39f1eb-65743556-beba0852-bdf3573e_0
2025-10-01T14:16:00.466634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cff877-6b5f463d-bc1df081-fd2ac347_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e39f1eb-65743556-beba0852-bdf3573e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:00.468125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256914209191151:5610]
2025-10-01T14:16:00.468463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209191151:5610], now have 1 active actors on pipe
2025-10-01T14:16:00.468782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2677, pipe: [1:7556256914209191151:5610]
2025-10-01T14:16:00.469372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Write session: try to update token
2025-10-01T14:16:00.469388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:00.487103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId: src_id|5e39f1eb-65743556-beba0852-bdf3573e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:00.489431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:00.490126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.490148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.490182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:00.490892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:00.518401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.518424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.518575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.518628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.518686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.518740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.518777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.518781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.518841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.518890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.518941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.518996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.519031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.519034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.519092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.519146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.519201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.519252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.519291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.519294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.519354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.519411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.519463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.519520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.519564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.519567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.519639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.519703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.519758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.519813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.519852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.519855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.519921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.519978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.520033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.520091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.520130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.520135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.520203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.520262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.520319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.520382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.520424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.520427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.520491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.520560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.520616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.520673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.520712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.520715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.520780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.520835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.520894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.520952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.520992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.520995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.521058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:00.521110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:00.521166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:00.521222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:00.521263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:00.521266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:00.521337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:16:00.521402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.521422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.521426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:16:00.521445Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521454Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521459Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521464Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521468Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521584Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521589Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521593Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521597Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521601Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521769Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521774Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521778Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521782Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521785Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521789Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521793Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521796Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521800Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521804Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521808Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521812Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521815Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521819Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521823Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521890Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521894Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521898Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521902Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521907Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521947Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521952Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521958Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521962Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.521966Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:16:00.522006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:16:00.522016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:16:00.522020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:16:00.522023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:16:00.522027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:16:00.522431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:16:00.522447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:16:00.522453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:16:00.522456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:16:00.522460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:16:00.522463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:16:00.522931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:16:00.522944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:16:00.522950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:16:00.522953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:16:00.522956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:16:00.522960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:16:00.523391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:16:00.523401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.523509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759328160523
2025-10-01T14:16:00.524236Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:16:00.524252Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:16:00.527239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:00.527255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:00.527258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:00.527260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:00.527270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.527275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.527279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256911832269043:6221]
2025-10-01T14:16:00.527322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:00.527326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.527329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:00.527463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:00.530561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:00.530573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:00.530576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:00.732769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:00.734142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:00.734161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:00.734189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2678 reason: error at write: Disconnected sessionId: src_id|5e39f1eb-65743556-beba0852-bdf3573e_0
2025-10-01T14:16:00.734722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:00.734734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Write session will restart in 0.006049s
2025-10-01T14:16:00.734759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Write session: Do CDS request
2025-10-01T14:16:00.734765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:00.734431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256914209191151:5610]
2025-10-01T14:16:00.734456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:00.735298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:00.737018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2678 sessionId: src_id|5e39f1eb-65743556-beba0852-bdf3573e_0 is DEAD
2025-10-01T14:16:00.741860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:00.742500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:00.742514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2679
2025-10-01T14:16:00.743112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:00.743149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:00.743156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:00.743159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:00.743928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2679 sessionId:  describe result for acl check
2025-10-01T14:16:00.743962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:00.743963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:00.743965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:00.743970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256914209191184:6794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:00.744522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256914209191184:6794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:00.752651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256914209191184:6794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:00.760398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256914209191184:6794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:00.760416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256914209191184:6794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:00.760419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256914209191184:6794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:00.760428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:00.786891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:00.787552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:00.787759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:00.787769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:00.787780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:00.787828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:00.787864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256911832269330:6224]
2025-10-01T14:16:00.788356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:00.788739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:00.788786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:00.789080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:00.789120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.789121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.789122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.789123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.789124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.789125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.789126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.789128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.789129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.789130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.789131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.789132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.789133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.789134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.789139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.789147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.789151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.789154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.789157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.789160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.789163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.789166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.789169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.789172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.789175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.789178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.789181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.789184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.789190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.789197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:00.789202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.789206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:00.789210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.789214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:00.789218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.789222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:00.789225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.789230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:00.789233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.789238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:00.789242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.789246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:00.789249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.789254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:00.789259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.789264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:00.789279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.789284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.789287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.789291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.789295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.789299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.789303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.789307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:00.789310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.789314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:00.789345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:00.793715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:00.794695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:00.794700Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:00.794702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:00.794705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:00.794711Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2678 [2:7556256911832269330:6224]
2025-10-01T14:16:00.794727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:00.794742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:00.794745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.794748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.794750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.794764Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:00.794768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:00.794773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:00.794823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.794825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.794826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.794829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:00.794832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:00.794895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:00.794897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.794908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:00.794917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:00.794930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:00.794946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.794948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.794950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.794961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:00.794973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:00.794985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:00.794987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:00.795009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.795011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:00.795188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:00.795194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:00.795196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:00.795200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:00.795767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2678
2025-10-01T14:16:00.795793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2678
2025-10-01T14:16:00.797791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209191258:6794], now have 1 active actors on pipe
2025-10-01T14:16:00.797802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209191169:2446], now have 1 active actors on pipe
2025-10-01T14:16:00.797820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.797827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.797860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:00.797871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:00.797876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:00.797879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:00.797892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:00.797906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:00.797922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:00.798511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:00.798521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:00.798539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:00.798692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2679 partition: 0 MaxSeqNo: 45 sessionId: src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0
2025-10-01T14:16:00.799117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39f1eb-65743556-beba0852-bdf3573e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:00.801721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Write session: try to update token
2025-10-01T14:16:00.801738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:00.820033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:00.820051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:00.820053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:00.820055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:00.820066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.820071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.820075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256911832269324:6224]
2025-10-01T14:16:00.820119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:00.820126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:00.820128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:00.820269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:00.821412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:00.821427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:00.821433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:00.821720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId: src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:00.824215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:00.834612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256914209191441:5610]
2025-10-01T14:16:00.834883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2678, pipe: [1:7556256914209191441:5610]
2025-10-01T14:16:01.022335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:01.022350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Write session will restart in 0.005685s
2025-10-01T14:16:01.021897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256914209191441:5610]
2025-10-01T14:16:01.022389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Write session: Do CDS request
2025-10-01T14:16:01.021924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:01.022396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:01.021926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:01.021979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2679 reason: error at write: Disconnected sessionId: src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0
2025-10-01T14:16:01.022164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2679 sessionId: src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0 is DEAD
2025-10-01T14:16:01.022280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:01.020551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:01.021085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.021095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.021138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256914209191441:5610], now have 1 active actors on pipe
2025-10-01T14:16:01.021583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:01.028851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:01.029502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:01.029518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2680
2025-10-01T14:16:01.029684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:01.029711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:01.029716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:01.029719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:01.030151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2680 sessionId:  describe result for acl check
2025-10-01T14:16:01.030186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:01.030188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:01.030189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:01.030195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256918504158750:6801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:01.030697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256918504158750:6801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:01.035289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256918504158750:6801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:01.048955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256918504158750:6801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:01.048973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256918504158750:6801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:01.048976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256918504158750:6801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:01.048985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:01.088158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:01.091439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:01.091682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:01.091686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:01.091697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:01.091744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:01.091778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256916127236923:6205]
2025-10-01T14:16:01.092337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:01.092661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:01.092700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:01.092973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:01.093024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.093030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.093031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.093032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.093033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.093034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.093035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.093036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.093038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.093039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.093040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.093041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.093042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.093043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.093048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.093056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.093059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.093062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.093066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.093069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.093072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.093075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.093078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.093082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.093096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.093100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.093102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.093106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.093112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.093120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.093125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.093129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.093133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.093138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.093144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.093156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.093164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.093168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.093172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.093177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.093185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.093190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.093195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.093199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.093204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.093209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.093213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.093218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.093221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.093226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.093230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.093235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.093239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.093243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.093250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.093255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.093292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:01.097475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:01.098072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:01.098090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:01.098092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:01.098096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:01.098103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2679 [2:7556256916127236923:6205]
2025-10-01T14:16:01.098118Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:01.098136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:01.098139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:01.098143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:01.098146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:01.098162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:01.098173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:01.098180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:01.098240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.098247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.098249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.098253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:01.098256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:01.098613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2679
2025-10-01T14:16:01.098643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2679
2025-10-01T14:16:01.098445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:01.098452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.098463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.098472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.098487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:01.098505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504158794:6801], now have 1 active actors on pipe
2025-10-01T14:16:01.098508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504158743:2446], now have 1 active actors on pipe
2025-10-01T14:16:01.098515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.098517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.098519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.098534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:01.098547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:01.098560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:01.098562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:01.098592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.098594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:01.098623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:01.098627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:01.098629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:01.098634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:01.098801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.098817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.098843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:01.098853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:01.098858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:01.098860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:01.098868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:01.098878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:01.098895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:01.099088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.099095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.099109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:01.101625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2680 partition: 0 MaxSeqNo: 45 sessionId: src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0
2025-10-01T14:16:01.102611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2ff78-1f6eb908-f9eaea3c-6d17eca2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:01.105170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Write session: try to update token
2025-10-01T14:16:01.105186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:01.119412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256918504159017:5610]
2025-10-01T14:16:01.120055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2679, pipe: [1:7556256918504159017:5610]
2025-10-01T14:16:01.129837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504159017:5610], now have 1 active actors on pipe
2025-10-01T14:16:01.129858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:16:01.129861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:01.129870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.129917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:16:01.130096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:16:01.130246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:16:01.130404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:16:01.130549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:16:01.131269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:16:01.133443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:16:01.133508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:16:01.134613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId: src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:01.137288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:01.138634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.138652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.138693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:01.138913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:01.157615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:01.157636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:01.157639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:01.157640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:01.157653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.157657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.157662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256916127236917:6205]
2025-10-01T14:16:01.157706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:01.157714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.157716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:01.157843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:01.160778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:01.160789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:01.160794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:01.422096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:01.448871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.448898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.449141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.449197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.449257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.449315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.449359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.449364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.449432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.449487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.449546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.449604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.449645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.449648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.449709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.449765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.449825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.449881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.449918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.449924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.449986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.450037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.450096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.450167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.450203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.450205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.450272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.450322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.450390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.450457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.450502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.450505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.450572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.450628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.450691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.450753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.450795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.450799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.450870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.450920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.450985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.451044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.451083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.451085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.451148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.451198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.451251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.451310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.451350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.451353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.451415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.451470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.451525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.451578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.451621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.451624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.451683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.451735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.451968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.459879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.459941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.459946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.462040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:01.462103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:01.462105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:01.462130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2680 reason: error at write: Disconnected sessionId: src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0
2025-10-01T14:16:01.462360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2680 sessionId: src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0 is DEAD
2025-10-01T14:16:01.462422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256918504159017:5610]
2025-10-01T14:16:01.462823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:01.462834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Write session will restart in 0.005404s
2025-10-01T14:16:01.462858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Write session: Do CDS request
2025-10-01T14:16:01.462864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:01.461771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:01.469981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:01.474173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:01.474190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2681
2025-10-01T14:16:01.474812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:01.474857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:01.474866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:01.474870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:01.475262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2681 sessionId:  describe result for acl check
2025-10-01T14:16:01.475291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:01.475293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:01.475295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:01.475299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256918504159071:6839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:01.475882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256918504159071:6839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:01.481861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256918504159071:6839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:01.492037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256918504159071:6839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:01.492052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256918504159071:6839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:01.492056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256918504159071:6839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:01.492064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:01.532331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:01.539713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:01.539964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:01.539968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:01.539979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:01.540026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:01.540058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256916127237204:6197]
2025-10-01T14:16:01.540706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:01.541248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:01.541284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:01.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:01.541647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.541648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.541649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.541650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.541652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.541653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.541654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.541656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.541657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.541658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.541660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.541661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.541663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.541668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.541678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.541681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.541685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.541688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.541692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.541695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.541699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.541702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.541706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.541716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.541720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.541723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.541727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.541734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.541741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.541747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.541752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.541756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.541761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.541765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.541770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.541775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.541780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.541783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.541788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.541792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.541798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.541804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.541809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.541814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.541819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.541823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.541838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.541842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.541848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.541856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.541861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.541865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.541870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.541874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.541879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.541915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:01.556468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:01.557255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:01.557262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:01.557264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:01.557268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:01.557275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2680 [2:7556256916127237204:6197]
2025-10-01T14:16:01.557291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:01.557311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:01.557314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:01.557318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:01.557320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:01.557336Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:01.557342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:01.557349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:01.557425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.557427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.557429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.557433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:01.557435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:01.557509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:01.557511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.557524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.557534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.557550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:01.557566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.557568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.557570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.557587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:01.557602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:01.557618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:01.557621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:01.557659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.557661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:01.557901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:01.557907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:01.557909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:01.557914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:01.558058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504159063:2446], now have 1 active actors on pipe
2025-10-01T14:16:01.558064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504159145:6839], now have 1 active actors on pipe
2025-10-01T14:16:01.561790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.561805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.561838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:01.561851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:01.561857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:01.561860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:01.561873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:01.561888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:01.561906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:01.558617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2680
2025-10-01T14:16:01.558655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2680
2025-10-01T14:16:01.563086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256918504159333:5610]
2025-10-01T14:16:01.565007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504159333:5610], now have 1 active actors on pipe
2025-10-01T14:16:01.565166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2680, pipe: [1:7556256918504159333:5610]
2025-10-01T14:16:01.566448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.566458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.566491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:01.567758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2681 partition: 0 MaxSeqNo: 45 sessionId: src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0
2025-10-01T14:16:01.570482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a60caa-86d43652-d6a0211f-d67a60f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:01.575556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Write session: try to update token
2025-10-01T14:16:01.575580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:01.596932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId: src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:01.599561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:01.601574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.601595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.601632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:01.604288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:01.611153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:01.611171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:01.611174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:01.611176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:01.611185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.611192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.611197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256916127237198:6197]
2025-10-01T14:16:01.611245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:01.611252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.611255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:01.611394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:01.614420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:01.614427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:01.614431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:01.904164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:01.912790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:01.912820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:01.912991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.913053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.913121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.913183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.913226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.913232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.913303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.913365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.913427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.913491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.913539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.913543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.913646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.913699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.913754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.913819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.913859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.913862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.913927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.913983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.914038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.914096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.914138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.914141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.914206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.914259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.914317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.914628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.914671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.914674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.914746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.914803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.914864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.914927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.914970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.914974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.915044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.915108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.915174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.915236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.915281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.915284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.915350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.915408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.915472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.915537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.915578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.915580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.915673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.915727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.915783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.915875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.915915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.915921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.915988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:01.916042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:01.916099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:01.916166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:01.916207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:01.916209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:01.917974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:01.919572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:01.919616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:01.919618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:01.919642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2681 reason: error at write: Disconnected sessionId: src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0
2025-10-01T14:16:01.919835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2681 sessionId: src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0 is DEAD
2025-10-01T14:16:01.919953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256918504159333:5610]
2025-10-01T14:16:01.925919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:01.925935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Write session will restart in 0.005339s
2025-10-01T14:16:01.925976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Write session: Do CDS request
2025-10-01T14:16:01.925983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:01.932879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:01.938744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:01.938764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2682
2025-10-01T14:16:01.938959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:01.938990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:01.939001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:01.939005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:01.940063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2682 sessionId:  describe result for acl check
2025-10-01T14:16:01.940102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:01.940106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:01.940108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:01.940113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256918504159383:6849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:01.940594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256918504159383:6849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:01.955466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256918504159383:6849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:01.965415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256918504159383:6849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:01.965431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256918504159383:6849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:01.965434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256918504159383:6849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:01.965443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:01.975303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:01.982641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:01.982895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:01.982900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:01.982912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:01.982985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:01.983019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256916127237496:6179]
2025-10-01T14:16:01.983577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:01.988188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:01.988282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:01.988664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:01.988708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.988710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.988711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.988712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.988713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.988715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.988717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.988718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.988719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.988720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.988721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.988722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.988723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.988725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.988732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.988742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.988748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.988753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.988757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.988761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.988764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.988768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.988771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.988775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.988779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.988782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.988786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.988789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.988795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.988803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:01.988809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.988814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:01.988818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.988823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:01.988827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.988832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:01.988836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.988841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:01.988845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.988850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:01.988854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.988858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:01.988863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.988868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:01.988872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.988877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:01.988880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.988885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.988891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.988897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.988902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.988906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.988910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.988915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:01.988919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.988923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:01.988963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:01.998270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:01.998848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:01.998854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:01.998856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:01.998860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:01.998866Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2681 [2:7556256916127237496:6179]
2025-10-01T14:16:01.998881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:01.998896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:01.998899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:01.998903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:01.998905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:01.998921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:01.998927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:01.998932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:01.998989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.998991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.998993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.998997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:01.999000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:01.999074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:01.999076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:01.999088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:01.999098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:01.999113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:01.999128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:01.999130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:01.999132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:01.999143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:01.999155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:01.999168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:01.999171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:01.999206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:01.999208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:01.999662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:01.999669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:01.999671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:01.999678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:01.999997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504159349:2446], now have 1 active actors on pipe
2025-10-01T14:16:02.000003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256918504159562:6849], now have 1 active actors on pipe
2025-10-01T14:16:02.003120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2681
2025-10-01T14:16:02.003156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2681
2025-10-01T14:16:02.005107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.005132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.005163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45046598-cccc7335-fd90e5f-6c63db96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:02.005179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:02.005184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:02.005188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:02.005198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:02.005212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:02.005235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:02.007757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.007771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.007801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:02.009290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2682 partition: 0 MaxSeqNo: 45 sessionId: src_id|45046598-cccc7335-fd90e5f-6c63db96_0
2025-10-01T14:16:02.009884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b81991-32d05d8b-9e9d0865-270b3a88_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|45046598-cccc7335-fd90e5f-6c63db96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:02.012667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Write session: try to update token
2025-10-01T14:16:02.012688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:02.019866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256922799126923:5610]
2025-10-01T14:16:02.020355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799126923:5610], now have 1 active actors on pipe
2025-10-01T14:16:02.020595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2681, pipe: [1:7556256922799126923:5610]
2025-10-01T14:16:02.044639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId: src_id|45046598-cccc7335-fd90e5f-6c63db96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:02.047067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:02.047783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.047803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.047839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:02.051657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:02.077082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:02.077101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:02.077104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:02.077106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:02.077116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:02.077121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:02.077125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256916127237482:6179]
2025-10-01T14:16:02.077172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:02.077180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.077182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:02.077322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:02.079313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:02.079323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:02.079328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:02.268111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:02.277476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.277569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.277739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.277798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.277869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.277929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.277969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.277975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.278039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.278090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.278144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.278208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.278246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.278249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.278315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.278368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.278446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.278510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.278550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.278553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.278628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.278685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.278743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.278799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.278849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.278852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.278921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.278974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.279033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.279096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.279137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.279140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.279204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.279256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.279312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.279370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.279410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.279413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.279479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.279537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.279597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.279651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.279689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.279692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.279751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.279802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.279892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.279946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.279983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.279986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.280045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.280094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.280148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.280203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.280243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.280246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.280305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.280353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.280410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.280504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.280555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.280558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.282202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:02.282798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:02.282802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:02.282839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2682 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45046598-cccc7335-fd90e5f-6c63db96_0
2025-10-01T14:16:02.282841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256922799126923:5610]
2025-10-01T14:16:02.283009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2682 sessionId: src_id|45046598-cccc7335-fd90e5f-6c63db96_0 is DEAD
2025-10-01T14:16:02.283617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:02.283624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Write session will restart in 0.007466s
2025-10-01T14:16:02.283648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Write session: Do CDS request
2025-10-01T14:16:02.283654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:02.292973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:02.293566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:02.293578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2683
2025-10-01T14:16:02.293747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:02.293774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:02.293779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:02.293782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:02.295519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2683 sessionId:  describe result for acl check
2025-10-01T14:16:02.295549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:02.295551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:02.295552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:02.295558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256922799126980:6861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:02.296044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256922799126980:6861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:02.313211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256922799126980:6861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:02.322825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256922799126980:6861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:02.322842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256922799126980:6861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:02.322845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256922799126980:6861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:02.322854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:02.327925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:02.335281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:02.335514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:02.335519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:02.335530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:02.335573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:02.335603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256920422205088:6169]
2025-10-01T14:16:02.336181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:02.340415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:02.340503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:02.340892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:02.340937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.340938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.340940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.340941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.340942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.340944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.340945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.340947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.340949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.340950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.340952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.340953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.340954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.340956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.340963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.340973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.340977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.340981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.340985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.340989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.340994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.340997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.341001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.341005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.341009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.341012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.341016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.341020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.341028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.341036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.341044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.341050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.341055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.341060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.341065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.341070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.341075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.341081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.341086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.341091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.341096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.341102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.341106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.341112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.341117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.341122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.341126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.341131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.341136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.341141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.341146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.341151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.341156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.341161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.341165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.341170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.341212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:02.346500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:02.347110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:02.347115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:02.347118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:02.347123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:02.347130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2682 [2:7556256920422205088:6169]
2025-10-01T14:16:02.347148Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:02.347167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:02.347170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:02.347174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:02.347176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:02.347194Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:02.347200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:02.347208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:02.347269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.347272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.347274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.347277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:02.347280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:02.347355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:02.347357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.347368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.347379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.347396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:02.347412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.347415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.347417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.347431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:02.347446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:02.347459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:02.347462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:02.347499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.347501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:02.347725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:02.347731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:02.347733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:02.347738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:02.350570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2682
2025-10-01T14:16:02.350601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2682
2025-10-01T14:16:02.351617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127192:6861], now have 1 active actors on pipe
2025-10-01T14:16:02.351628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799126946:2446], now have 1 active actors on pipe
2025-10-01T14:16:02.351647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.351654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.351684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17cbb318-9849e118-5011b088-523dacbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:02.351694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:02.351699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:02.351702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:02.351714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:02.351730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:02.351748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:02.352059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.352065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.352077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:02.352207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2683 partition: 0 MaxSeqNo: 45 sessionId: src_id|17cbb318-9849e118-5011b088-523dacbc_0
2025-10-01T14:16:02.352593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45046598-cccc7335-fd90e5f-6c63db96_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|17cbb318-9849e118-5011b088-523dacbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:02.354997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Write session: try to update token
2025-10-01T14:16:02.355014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:02.386460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256922799127222:5610]
2025-10-01T14:16:02.390800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127222:5610], now have 1 active actors on pipe
2025-10-01T14:16:02.388724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId: src_id|17cbb318-9849e118-5011b088-523dacbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:02.390962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2682, pipe: [1:7556256922799127222:5610]
2025-10-01T14:16:02.391021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:02.393234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.393250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.393285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:02.393392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:02.399101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:02.399115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:02.399118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:02.399120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:02.399128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.399133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.399137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256920422205081:6169]
2025-10-01T14:16:02.399181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:02.399188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.399191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:02.399319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:02.402509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:02.402519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:02.402523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:02.621755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:02.629885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.629909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.630072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.630125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.630179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.630236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.630710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.630721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.630786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.630838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.630892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.630948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.630984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.630987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.631045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.631098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.631147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.631197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.631233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.631235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.631290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.631346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.631396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.631448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.631482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.631485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.631538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.631586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.631639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.631691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.631728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.631730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.631792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.631846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.631900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.631953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.631990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.631993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.632057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.632109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.632168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.632223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.632261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.632265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.632326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.632380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.632436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.632489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.632555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.632558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.632618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.632670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.632721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.632773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.632907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.632909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.632971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.633023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.633077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.633129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.633235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.633238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.634176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:02.634117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:02.634130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:02.634154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2683 reason: error at write: Disconnected sessionId: src_id|17cbb318-9849e118-5011b088-523dacbc_0
2025-10-01T14:16:02.634328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2683 sessionId: src_id|17cbb318-9849e118-5011b088-523dacbc_0 is DEAD
2025-10-01T14:16:02.634434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256922799127222:5610]
2025-10-01T14:16:02.634452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:02.634788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:02.634798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Write session will restart in 0.006475s
2025-10-01T14:16:02.634824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Write session: Do CDS request
2025-10-01T14:16:02.634830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:02.642859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:02.643223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:02.643241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2684
2025-10-01T14:16:02.643396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:02.643428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:02.643434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:02.643437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:02.644401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2684 sessionId:  describe result for acl check
2025-10-01T14:16:02.644442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:02.644444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:02.644445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:02.644450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256922799127264:6886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:02.644970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256922799127264:6886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:02.649997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256922799127264:6886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:02.659502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256922799127264:6886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:02.659522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256922799127264:6886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:02.659526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256922799127264:6886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:02.659534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:02.687233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:02.690695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:02.690902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:02.690912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:02.690922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:02.690970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:02.691009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256920422205367:6158]
2025-10-01T14:16:02.691544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:02.691924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:02.691968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:02.692250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:02.692309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.692314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.692315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.692316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.692317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.692319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.692320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.692321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.692322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.692323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.692324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.692324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.692325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.692326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.692331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.692340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.692343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.692347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.692350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.692353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.692356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.692360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.692363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.692368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.692371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.692374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.692377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.692381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.692387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.692394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:02.692400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.692405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:02.692409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.692414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:02.692418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.692423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:02.692429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.692433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:02.692437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.692441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:02.692447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.692454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:02.692457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.692461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:02.692465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.692469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:02.692473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.692477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.692481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.692485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.692488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.692493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.692496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.692501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:02.692520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.692524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:02.692557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:02.696515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:02.697258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:02.697264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:02.697266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:02.697269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:02.697275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2683 [2:7556256920422205367:6158]
2025-10-01T14:16:02.697290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:02.697308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:02.697312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:02.697315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:02.697317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:02.697334Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:02.697339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:02.697345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:02.697399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.697401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.697402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.697405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:02.697408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:02.697471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:02.697473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.697483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:02.697493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:02.697507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:02.697523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.697525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.697527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.697537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:02.697549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:02.697563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:02.697566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:02.697593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.697595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:02.698430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2683
2025-10-01T14:16:02.698471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2683
2025-10-01T14:16:02.697841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:02.697847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:02.697849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:02.697854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:02.698940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127256:2446], now have 1 active actors on pipe
2025-10-01T14:16:02.698948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127349:6886], now have 1 active actors on pipe
2025-10-01T14:16:02.698965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.698970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.698996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8760595d-f069b9ea-20fdb911-33d7c666_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:02.699005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:02.699009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:02.699011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:02.699020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:02.699031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:02.699045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:02.699363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.699369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.699382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:02.699512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2684 partition: 0 MaxSeqNo: 45 sessionId: src_id|8760595d-f069b9ea-20fdb911-33d7c666_0
2025-10-01T14:16:02.701371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cbb318-9849e118-5011b088-523dacbc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8760595d-f069b9ea-20fdb911-33d7c666_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:02.704382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Write session: try to update token
2025-10-01T14:16:02.704398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:02.725573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:16:02.728484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId: src_id|8760595d-f069b9ea-20fdb911-33d7c666_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:02.731124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:02.734662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:02.734682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.734743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.734752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.734776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:16:02.734960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:16:02.735110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:16:02.735243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:16:02.735378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:16:02.735566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:16:02.735623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:16:02.735891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:02.735983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:16:02.736442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127537:5610], now have 1 active actors on pipe
2025-10-01T14:16:02.736084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:02.736088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256922799127537:5610]
2025-10-01T14:16:02.736404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2683, pipe: [1:7556256922799127537:5610]
2025-10-01T14:16:02.772915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:02.772930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:02.772932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:02.772934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:02.772943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.772948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.772952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256920422205361:6158]
2025-10-01T14:16:02.772995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:02.773001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:02.773002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:02.773131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:02.774529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:02.774544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:02.774547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:02.933018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:02.941682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:02.941714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:02.941892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.941950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.942013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.942073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.942111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.942120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.942189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.942246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.942304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.942681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.942736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.942739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.942807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.942863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.942921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.942981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.943022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.943029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.943094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.943150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.943210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.943271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.943311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.943313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.943378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.943434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.943489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.943547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.943584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.943587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.943652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.943711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.943773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.943832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.943873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.943876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.943943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.943998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.944059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.944115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.944156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.944160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.944229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.944294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.944354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.944412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.944452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.944455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.944539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.944599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.944656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.944716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.944752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.944755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.944820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:02.944875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:02.944930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:02.944983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:02.945024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:02.945026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:02.947564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256922799127537:5610]
2025-10-01T14:16:02.947594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:02.947632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2684 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8760595d-f069b9ea-20fdb911-33d7c666_0
2025-10-01T14:16:02.947837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2684 sessionId: src_id|8760595d-f069b9ea-20fdb911-33d7c666_0 is DEAD
2025-10-01T14:16:02.947972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:02.946787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:02.950644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:02.950657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Write session will restart in 0.005470s
2025-10-01T14:16:02.950683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Write session: Do CDS request
2025-10-01T14:16:02.950689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:02.961955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:02.962245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:02.962266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2685
2025-10-01T14:16:02.964927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:02.964984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:02.964992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:02.964996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:02.965504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2685 sessionId:  describe result for acl check
2025-10-01T14:16:02.965534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:02.965536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:02.965537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:02.965542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256922799127557:6905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:02.966124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256922799127557:6905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:02.969724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256922799127557:6905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:02.988907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256922799127557:6905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:02.988926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256922799127557:6905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:02.988930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256922799127557:6905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:02.988938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:03.026434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:03.033510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:03.033765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:03.033771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:03.033783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:03.033831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:03.033863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256924717172950:6151]
2025-10-01T14:16:03.034516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:03.034912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:03.034951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:03.035275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:03.035320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.035322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.035323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.035324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.035325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.035327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.035328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.035329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.035330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.035332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.035333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.035334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.035335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.035336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.035342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.035351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.035355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.035359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.035363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.035366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.035370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.035374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.035378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.035382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.035385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.035389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.035393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.035396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.035404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.035412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.035418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.035423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.035427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.035432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.035436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.035441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.035445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.035450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.035454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.035459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.035464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.035469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.035473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.035478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.035482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.035487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.035492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.035497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.035502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.035507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.035511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.035516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.035521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.035525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.035529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.035534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.035573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:03.042755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:03.043411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:03.043417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:03.043419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:03.043423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:03.043432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2684 [2:7556256924717172950:6151]
2025-10-01T14:16:03.043449Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:03.043468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:03.043472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.043476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.043478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.043495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:03.043500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:03.043506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:03.043563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.043567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.043569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.043573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:03.043575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:03.043985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:03.043988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.044000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.044011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.044029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:03.044045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.050699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256927094095109:5610]
2025-10-01T14:16:03.051592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2684
2025-10-01T14:16:03.051618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2684
2025-10-01T14:16:03.051635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2684, pipe: [1:7556256927094095109:5610]
2025-10-01T14:16:03.044047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.044049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.044063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:03.044077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:03.044091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:03.044095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:03.044130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.044132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:03.050853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:03.050856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:03.050858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:03.050865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:03.051337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127651:6905], now have 1 active actors on pipe
2025-10-01T14:16:03.051342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256922799127541:2446], now have 1 active actors on pipe
2025-10-01T14:16:03.051345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095109:5610], now have 1 active actors on pipe
2025-10-01T14:16:03.054554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.054575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.054612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:03.054624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.054629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.054632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:03.054643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.054659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:03.054679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.062434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.062454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.062490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.063126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2685 partition: 0 MaxSeqNo: 45 sessionId: src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0
2025-10-01T14:16:03.066506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8760595d-f069b9ea-20fdb911-33d7c666_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:03.075412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Write session: try to update token
2025-10-01T14:16:03.075436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:03.095577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:03.095598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:03.095601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:03.095603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:03.095611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.095618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.095622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256924717172944:6151]
2025-10-01T14:16:03.095667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:03.095674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.095677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:03.095804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:03.098699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:03.098710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:03.098714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:03.113306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId: src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:03.116990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:03.272805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:03.273216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.273225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.273590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:03.274008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256927094095109:5610]
2025-10-01T14:16:03.274038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:03.274042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:03.274090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2685 reason: error at write: Disconnected sessionId: src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0
2025-10-01T14:16:03.274280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2685 sessionId: src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0 is DEAD
2025-10-01T14:16:03.274401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:03.274646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:03.274655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Write session will restart in 0.005959s
2025-10-01T14:16:03.274680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Write session: Do CDS request
2025-10-01T14:16:03.274689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:03.281866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:03.282099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:03.282113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2686
2025-10-01T14:16:03.282264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:03.282293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:03.282298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:03.282301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:03.282743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2686 sessionId:  describe result for acl check
2025-10-01T14:16:03.282778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:03.282780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:03.282782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:03.282788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256927094095143:6915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:03.283287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256927094095143:6915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:03.292931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256927094095143:6915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:03.299321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256927094095143:6915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:03.299336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256927094095143:6915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:03.299339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256927094095143:6915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:03.299347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:03.359932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:03.360321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:03.360546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:03.360558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:03.360572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:03.360631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:03.360675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256924717173255:6135]
2025-10-01T14:16:03.361307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:03.361768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:03.361807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:03.362140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:03.362200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.362201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.362202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.362203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.362205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.362206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.362208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.362209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.362211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.362212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.362214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.362215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.362217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.362218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.362223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.362232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.362236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.362240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.362243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.362247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.362251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.362255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.362258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.362262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.362266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.362269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.362273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.362276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.362283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.362291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.362296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.362301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.362306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.362311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.362316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.362321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.362325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.362330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.362334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.362339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.362344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.362349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.362353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.362359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.362363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.362381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.362385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.362390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.362396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.362400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.362404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.362409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.362414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.362418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.362423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.362437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.362476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:03.367626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:03.368393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:03.368398Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:03.368401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:03.368405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:03.368412Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2685 [2:7556256924717173255:6135]
2025-10-01T14:16:03.368429Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:03.368446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:03.368449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.368453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.368455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.368470Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:03.368475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:03.368481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:03.368548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.368550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.368552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.368555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:03.368557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:03.368625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:03.368639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.368650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.368660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.368675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:03.368691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.368693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.368695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.368706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:03.368718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:03.368731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:03.368733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:03.368763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.368765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:03.368838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:03.368840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:03.368842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:03.368846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:03.369592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2685
2025-10-01T14:16:03.369624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2685
2025-10-01T14:16:03.369990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095185:6915], now have 1 active actors on pipe
2025-10-01T14:16:03.369999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095136:2446], now have 1 active actors on pipe
2025-10-01T14:16:03.370017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.370023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.370049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d9a4725-5f9799f2-142efaac-c00df179_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:03.370057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.370065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.370067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:03.370077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.370087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:03.370115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.370670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.370699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.370718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.370896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2686 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d9a4725-5f9799f2-142efaac-c00df179_0
2025-10-01T14:16:03.371339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256ebf3b-c8d02f60-544ef7af-2f194811_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d9a4725-5f9799f2-142efaac-c00df179_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:03.371649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256927094095414:5610]
2025-10-01T14:16:03.372057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2685, pipe: [1:7556256927094095414:5610]
2025-10-01T14:16:03.372104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095414:5610], now have 1 active actors on pipe
2025-10-01T14:16:03.374176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Write session: try to update token
2025-10-01T14:16:03.374206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:03.392705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId: src_id|8d9a4725-5f9799f2-142efaac-c00df179_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:03.395415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:03.398540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.398560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.398597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:03.398715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:03.426099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:03.426112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:03.426114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:03.426116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:03.426124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.426128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.426131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256924717173249:6135]
2025-10-01T14:16:03.426166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:03.426172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.426173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:03.426197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:03.426203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:03.426211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:03.426296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:03.606274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:03.631343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.631367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.631537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.631596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.631658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.631718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.631760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.631765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.631840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.631909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.631971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.632038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.632081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.632084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.632149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.632204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.632263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.632321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.632360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.632363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.632426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.632483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.632556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.632617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.632662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.632665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.632731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.632789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.632846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.632904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.632944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.632947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.633022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.633083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.633147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.633210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.633254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.633257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.633330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.633412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.633507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.633597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.633644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.633648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.633738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.633817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.633898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.633959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.634001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.634004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.634076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.634139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.634203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.634262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.634304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.634307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.634635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:03.634700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:03.635440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:03.635451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:03.635472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2686 reason: error at write: Disconnected sessionId: src_id|8d9a4725-5f9799f2-142efaac-c00df179_0
2025-10-01T14:16:03.635616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2686 sessionId: src_id|8d9a4725-5f9799f2-142efaac-c00df179_0 is DEAD
2025-10-01T14:16:03.635720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256927094095414:5610]
2025-10-01T14:16:03.635735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:03.634766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:03.634842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:03.634890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:03.634894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:03.636529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:03.640636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:03.640650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Write session will restart in 0.008941s
2025-10-01T14:16:03.640676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Write session: Do CDS request
2025-10-01T14:16:03.640682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:03.650808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:03.654760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:03.654774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2687
2025-10-01T14:16:03.655119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:03.655149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:03.655154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:03.655158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:03.656258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2687 sessionId:  describe result for acl check
2025-10-01T14:16:03.656287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:03.656289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:03.656291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:03.656296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256927094095476:6946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:03.656826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256927094095476:6946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:03.662556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256927094095476:6946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:03.668460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256927094095476:6946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:03.668476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256927094095476:6946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:03.668479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256927094095476:6946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:03.668488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:03.675048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:03.679131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:03.679354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:03.679365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:03.679376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:03.679427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:03.679468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256924717173537:6123]
2025-10-01T14:16:03.680105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:03.680540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:03.680598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:03.680917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:03.680991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.680998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.680999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.681001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.681002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.681003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.681004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.681005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.681006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.681007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.681008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.681009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.681010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.681011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.681016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.681026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.681029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.681032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.681036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.681040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.681043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.681047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.681050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.681054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.681057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.681060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.681064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.681067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.681074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.681081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.681088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.681092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.681096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.681100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.681107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.681111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.681115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.681120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.681124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.681133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.681138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.681142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.681151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.681155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.681159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.681168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.681172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.681176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.681182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.681190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.681194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.681198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.681205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.681209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.681214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.681219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.681252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:03.690078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:03.690897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:03.690911Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:03.690913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:03.690917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:03.690924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2686 [2:7556256924717173537:6123]
2025-10-01T14:16:03.690942Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:03.690959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:03.690966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.690969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.690972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.690988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:03.690994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:03.691012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:03.691075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.691077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.691080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.691083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:03.691085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:03.691163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:03.691166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.691178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.691190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.691207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:03.691222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.691225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.691227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.691235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:03.691245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:03.691247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:03.691248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:03.691250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:03.691263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:03.691266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:03.691276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095622:6946], now have 1 active actors on pipe
2025-10-01T14:16:03.691280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095439:2446], now have 1 active actors on pipe
2025-10-01T14:16:03.691311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.691317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:03.691323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:03.691560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.691572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.691602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfdd3682-6a88e816-d14ece92-c2541911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:03.691611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.691616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.691619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:03.691630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.691641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:03.691655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.691837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.691843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.691857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.692331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9a4725-5f9799f2-142efaac-c00df179_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dfdd3682-6a88e816-d14ece92-c2541911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:03.691374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2686
2025-10-01T14:16:03.691425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2686
2025-10-01T14:16:03.691941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2687 partition: 0 MaxSeqNo: 45 sessionId: src_id|dfdd3682-6a88e816-d14ece92-c2541911_0
2025-10-01T14:16:03.695140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Write session: try to update token
2025-10-01T14:16:03.695160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:03.724893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:03.724912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:03.724915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:03.724917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:03.724927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.724936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.724940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256924717173532:6123]
2025-10-01T14:16:03.724989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:03.724996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.724999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:03.725170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:03.727460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:03.727479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:03.727485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:03.727558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId: src_id|dfdd3682-6a88e816-d14ece92-c2541911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:03.729960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:03.735075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256927094095734:5610]
2025-10-01T14:16:03.735415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2686, pipe: [1:7556256927094095734:5610]
2025-10-01T14:16:03.901194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:03.901807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.901817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.901858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095734:5610], now have 1 active actors on pipe
2025-10-01T14:16:03.902312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:03.902134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:03.902147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:03.902203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2687 reason: error at write: Disconnected sessionId: src_id|dfdd3682-6a88e816-d14ece92-c2541911_0
2025-10-01T14:16:03.902399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2687 sessionId: src_id|dfdd3682-6a88e816-d14ece92-c2541911_0 is DEAD
2025-10-01T14:16:03.902551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:03.902592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256927094095734:5610]
2025-10-01T14:16:03.906452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:03.906464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Write session will restart in 0.006050s
2025-10-01T14:16:03.906490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Write session: Do CDS request
2025-10-01T14:16:03.906496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:03.914773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:03.915099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:03.915113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2688
2025-10-01T14:16:03.915234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:03.915264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:03.915269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:03.915272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:03.915677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2688 sessionId:  describe result for acl check
2025-10-01T14:16:03.915705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:03.915706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:03.915709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:03.915714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256927094095761:6965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:03.916180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256927094095761:6965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:03.929982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256927094095761:6965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:03.935147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256927094095761:6965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:03.935164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256927094095761:6965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:03.935167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256927094095761:6965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:03.935176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:03.939398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:03.943490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:03.943708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:03.943717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:03.943728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:03.943770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:03.943805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256924717173823:6116]
2025-10-01T14:16:03.944441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:03.944944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:03.945013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:03.945335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:03.945406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.945413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.945414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.945415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.945416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.945418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.945419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.945420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.945422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.945424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.945425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.945427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.945428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.945429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.945436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.945446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.945449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.945453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.945457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.945461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.945464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.945468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.945472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.945476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.945480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.945484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.945488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.945492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.945500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.945508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:03.945515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.945521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:03.945526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.945538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:03.945544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.945549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:03.945554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.945564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:03.945567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.945572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:03.945582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.945586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:03.945595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.945600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:03.945608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.945613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:03.945622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.945626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.945631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.945641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.945645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.945653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.945657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.945661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:03.945665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.945673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:03.945711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:03.950259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:03.950928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:03.950948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:03.950951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:03.950955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:03.950963Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2687 [2:7556256924717173823:6116]
2025-10-01T14:16:03.950983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:03.951001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:03.951004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.951009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.951019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.951035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:03.951044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:03.951050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:03.951116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.951122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.951124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.951128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:03.951130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:03.951199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:03.951208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.951219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:03.951227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:03.951242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:03.951260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095737:2446], now have 1 active actors on pipe
2025-10-01T14:16:03.951263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256927094095970:6965], now have 1 active actors on pipe
2025-10-01T14:16:03.951270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.951272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.951274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.951286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:03.951299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:03.951311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:03.951314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:03.951339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:03.951346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.951346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:03.951348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:03.951348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:03.951353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:03.955714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2687
2025-10-01T14:16:03.955761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2687
2025-10-01T14:16:03.959395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.959418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.959458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:03.959469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:03.959474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:03.959477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:03.959490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:03.959507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:03.959528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.961105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:03.961122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:03.961145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:03.962596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdd3682-6a88e816-d14ece92-c2541911_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:03.961707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2688 partition: 0 MaxSeqNo: 45 sessionId: src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0
2025-10-01T14:16:03.964943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Write session: try to update token
2025-10-01T14:16:03.964957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:03.980605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:03.980623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:03.980625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:03.980627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:03.980635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.980639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.980642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256924717173818:6116]
2025-10-01T14:16:03.980684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:03.980687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:03.980692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:03.980694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:03.980697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:03.980697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:03.980827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:03.990961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId: src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:03.993351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:04.006429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256931389063315:5610]
2025-10-01T14:16:04.006836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2687, pipe: [1:7556256931389063315:5610]
2025-10-01T14:16:04.164053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:04.164304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.164318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.164358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063315:5610], now have 1 active actors on pipe
2025-10-01T14:16:04.166568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:04.170479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:04.170527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:04.170594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2688 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0
2025-10-01T14:16:04.170758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2688 sessionId: src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0 is DEAD
2025-10-01T14:16:04.170878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256931389063315:5610]
2025-10-01T14:16:04.171129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:04.171141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Write session will restart in 0.007000s
2025-10-01T14:16:04.171167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Write session: Do CDS request
2025-10-01T14:16:04.171173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:04.178971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:04.179270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:04.179289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2689
2025-10-01T14:16:04.179499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:04.179527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:04.179536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:04.179539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:04.180135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2689 sessionId:  describe result for acl check
2025-10-01T14:16:04.180161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:04.180168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:04.180171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:04.180176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256931389063327:6968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:04.180658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256931389063327:6968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:04.186252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256931389063327:6968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:04.188881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256931389063327:6968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:04.188896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256931389063327:6968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:04.188899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256931389063327:6968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:04.188907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:04.223121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:04.226489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:04.226668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:04.226677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:04.226687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:04.226727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:04.226764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256929012141427:6107]
2025-10-01T14:16:04.227292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:04.227623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:04.227676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:04.227937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:04.227985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.227991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.227992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.227993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.227994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.227996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.227997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.227998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.227999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.228000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.228001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.228002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.228003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.228005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.228010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.228020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.228023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.228028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.228032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.228036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.228039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.228043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.228047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.228050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.228054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.228058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.228063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.228067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.228074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.228086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.228092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.228097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.228102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.228107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.228112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.228117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.228125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.228130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.228134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.228140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.228148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.228152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.228157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.228161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.228165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.228170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.228175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.228180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.228184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.228189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.228194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.228200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.228205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.228210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.228215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.228220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:04.232625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:04.233228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:04.233233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:04.233236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:04.233239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:04.233245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2688 [2:7556256929012141427:6107]
2025-10-01T14:16:04.233262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:04.233278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:04.233280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:04.233283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:04.233286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:04.233303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:04.233309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:04.233315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:04.233368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.233630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2688
2025-10-01T14:16:04.233370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.233372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.233669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2688
2025-10-01T14:16:04.233375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:04.233378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:04.233448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:04.233450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.233460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.233470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.233486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:04.233502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.233505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.233507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.233516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:04.233523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:04.233526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:04.233529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:04.233531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063369:6968], now have 1 active actors on pipe
2025-10-01T14:16:04.233537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:04.233549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:04.233553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:04.233558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063320:2446], now have 1 active actors on pipe
2025-10-01T14:16:04.233586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.233595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:04.233604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:04.233674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.233680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.233706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63dbe342-85c23cb3-23257791-82811169_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:04.233713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:04.233717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:04.233720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:04.233729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:04.233738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:04.233765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:04.233951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.233960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.233975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:04.234094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2689 partition: 0 MaxSeqNo: 45 sessionId: src_id|63dbe342-85c23cb3-23257791-82811169_0
2025-10-01T14:16:04.234469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534a519-ac3a2a9e-2d715175-1e9aa83c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63dbe342-85c23cb3-23257791-82811169_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:04.236936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Write session: try to update token
2025-10-01T14:16:04.236952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:04.272535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:04.272553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:04.272555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:04.272557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:04.272566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.272571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.272575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256929012141421:6107]
2025-10-01T14:16:04.272622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:04.272629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.272631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:04.272764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:04.274458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256931389063615:5610]
2025-10-01T14:16:04.274489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:04.274499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:04.274503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:04.278540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2688, pipe: [1:7556256931389063615:5610]
2025-10-01T14:16:04.279098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId: src_id|63dbe342-85c23cb3-23257791-82811169_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:04.281444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:04.443362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:04.444112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063615:5610], now have 1 active actors on pipe
2025-10-01T14:16:04.444142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.444150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.445162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:04.447581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:04.447594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Write session will restart in 0.008544s
2025-10-01T14:16:04.447617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Write session: Do CDS request
2025-10-01T14:16:04.447624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:04.446861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256931389063615:5610]
2025-10-01T14:16:04.446892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:04.446957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2689 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63dbe342-85c23cb3-23257791-82811169_0
2025-10-01T14:16:04.447123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2689 sessionId: src_id|63dbe342-85c23cb3-23257791-82811169_0 is DEAD
2025-10-01T14:16:04.447282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:04.457577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:04.458494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:04.458508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2690
2025-10-01T14:16:04.458720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:04.458748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:04.458754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:04.458757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:04.459114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2690 sessionId:  describe result for acl check
2025-10-01T14:16:04.459142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:04.459144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:04.459146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:04.459150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256931389063628:6980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:04.459634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256931389063628:6980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:04.463601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256931389063628:6980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:04.473093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256931389063628:6980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:04.473108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256931389063628:6980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:04.473112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256931389063628:6980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:04.473120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:04.496991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:04.500059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:04.500261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:04.500265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:04.500275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:04.500315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:04.500348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256929012141705:6096]
2025-10-01T14:16:04.500971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:04.506746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:04.506815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:04.507206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:04.507256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.507257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.507259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.507260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.507261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.507262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.507264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.507265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.507266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.507268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.507269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.507270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.507272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.507273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.507279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.507289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.507293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.507297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.507301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.507305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.507308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.507312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.507316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.507319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.507323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.507327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.507331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.507334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.507341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.507349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.507355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.507359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.507363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.507368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.507372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.507377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.507382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.507387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.507391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.507396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.507400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.507406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.507410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.507415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.507419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.507424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.507428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.507433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.507437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.507442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.507449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.507454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.507458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.507463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.507468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.507472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.507511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:04.516859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:04.517462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:04.517468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:04.517470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:04.517474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:04.517481Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2689 [2:7556256929012141705:6096]
2025-10-01T14:16:04.517496Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:04.517513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:04.517516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:04.517520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:04.517522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:04.517538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:04.517544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:04.517550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:04.517605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.517607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.517609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.517612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:04.517614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:04.517683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:04.517685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.517696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.517705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.517720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:04.517736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.517739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.517741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.517753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:04.517766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:04.517779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:04.517782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:04.517815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.517817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:04.518032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:04.518038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:04.518040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:04.518045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:04.518211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063618:2446], now have 1 active actors on pipe
2025-10-01T14:16:04.518219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063704:6980], now have 1 active actors on pipe
2025-10-01T14:16:04.518464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2689
2025-10-01T14:16:04.518508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2689
2025-10-01T14:16:04.521025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.521037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.521065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:04.521074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:04.521078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:04.521081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:04.521090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:04.521102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:04.521115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:04.521482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.521493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.521510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:04.521666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2690 partition: 0 MaxSeqNo: 45 sessionId: src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0
2025-10-01T14:16:04.522034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dbe342-85c23cb3-23257791-82811169_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:04.524481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Write session: try to update token
2025-10-01T14:16:04.524499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:04.543985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:04.544007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:04.544010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:04.544012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:04.544022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.544027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.544031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256929012141699:6096]
2025-10-01T14:16:04.544079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:04.544089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.544091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:04.544226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:04.546515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:04.546530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:04.546534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:04.547006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId: src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:04.549710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:04.549795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256931389063903:5610]
2025-10-01T14:16:04.550058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2689, pipe: [1:7556256931389063903:5610]
2025-10-01T14:16:04.734022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:04.739279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.739307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.739332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063903:5610], now have 1 active actors on pipe
2025-10-01T14:16:04.739562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:04.742745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:04.742752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256931389063903:5610]
2025-10-01T14:16:04.742774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:04.742848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2690 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0
2025-10-01T14:16:04.743033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2690 sessionId: src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0 is DEAD
2025-10-01T14:16:04.743286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:04.743298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Write session will restart in 0.006304s
2025-10-01T14:16:04.743329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Write session: Do CDS request
2025-10-01T14:16:04.743337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:04.750955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:04.751030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:04.751048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2691
2025-10-01T14:16:04.751145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:04.751174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:04.751184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:04.751187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:04.751708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2691 sessionId:  describe result for acl check
2025-10-01T14:16:04.751750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:04.751751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:04.751753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:04.751759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256931389063946:7012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:04.752379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256931389063946:7012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:04.777551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256931389063946:7012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:04.788649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256931389063946:7012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:04.788667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256931389063946:7012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:04.788671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256931389063946:7012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:04.788679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:04.826132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:04.826875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:04.827071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:04.827076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:04.827088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:04.827135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:04.827172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256929012142003:6079]
2025-10-01T14:16:04.827864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:04.828275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:04.828320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:04.828640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:04.828708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.828710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.828711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.828712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.828713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.828715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.828716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.828717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.828719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.828720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.828722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.828723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.828724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.828726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.828731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.828742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.828746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.828750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.828754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.828759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.828762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.828765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.828768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.828772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.828775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.828779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.828783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.828787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.828795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.828803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:04.828809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.828815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:04.828820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.828826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:04.828831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.828837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:04.828842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.828847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:04.828852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.828857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:04.828862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.828867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:04.828872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.828878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:04.828882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.828888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:04.828892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.828897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.828902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.828908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.828912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.828918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.828923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.828928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:04.828933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.828938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:04.828980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:04.833753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:04.834364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:04.834383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:04.834386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:04.834390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:04.834397Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2690 [2:7556256929012142003:6079]
2025-10-01T14:16:04.834413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:04.834429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:04.834432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:04.834435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:04.834437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:04.834452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:04.834457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:04.834464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:04.834519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.834522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.834523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.834526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:04.834529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:04.834601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:04.834604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.834614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:04.834623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:04.834638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:04.834655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.834657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.834659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.834666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:04.834671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:04.834674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:04.834676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:04.834680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389063939:2446], now have 1 active actors on pipe
2025-10-01T14:16:04.834686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389064066:7012], now have 1 active actors on pipe
2025-10-01T14:16:04.834691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:04.834703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:04.834707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:04.834738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.834744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:04.835000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2690
2025-10-01T14:16:04.835038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2690
2025-10-01T14:16:04.835125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:04.837527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.837543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.837583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6001c0b-580153c6-65912e28-be911b7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:04.837595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:04.837601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:04.837604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:04.837618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:04.837634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:04.837655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:04.838329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.838339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.838359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:04.838705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2691 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6001c0b-580153c6-65912e28-be911b7c_0
2025-10-01T14:16:04.839193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6843d538-e52ff912-e6125ca6-5cbb6cbd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6001c0b-580153c6-65912e28-be911b7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:04.842244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Write session: try to update token
2025-10-01T14:16:04.842264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:04.845799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256931389064220:5610]
2025-10-01T14:16:04.846264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256931389064220:5610], now have 1 active actors on pipe
2025-10-01T14:16:04.846396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2690, pipe: [1:7556256931389064220:5610]
2025-10-01T14:16:04.874093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId: src_id|d6001c0b-580153c6-65912e28-be911b7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:04.876789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:04.878616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:04.878640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:04.878660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:04.878663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:04.878666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:04.878668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:04.878676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.878681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.878684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256929012141997:6079]
2025-10-01T14:16:04.878739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:04.878746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:04.878748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:04.878882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:04.880844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:04.880854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:04.880858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:05.030347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:05.038984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:05.039245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:05.041174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256931389064220:5610]
2025-10-01T14:16:05.041215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:05.058797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:05.058810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:05.058835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2691 reason: error at write: Disconnected sessionId: src_id|d6001c0b-580153c6-65912e28-be911b7c_0
2025-10-01T14:16:05.058970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2691 sessionId: src_id|d6001c0b-580153c6-65912e28-be911b7c_0 is DEAD
2025-10-01T14:16:05.059645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:05.059655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Write session will restart in 0.005175s
2025-10-01T14:16:05.059680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Write session: Do CDS request
2025-10-01T14:16:05.059686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:05.065839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:05.066133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:05.066146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2692
2025-10-01T14:16:05.066317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:05.066347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:05.066352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:05.066355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:05.066975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2692 sessionId:  describe result for acl check
2025-10-01T14:16:05.067007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:05.067010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:05.067013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:05.067018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256935684031620:7023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:05.067519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256935684031620:7023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:05.074807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256935684031620:7023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:05.079606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256935684031620:7023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:05.079621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256935684031620:7023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:05.079624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256935684031620:7023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:05.079631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:05.082393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:05.085090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:05.085258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:05.085267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:05.085277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:05.085322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:05.085360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256933307109581:6075]
2025-10-01T14:16:05.085745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:05.086046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:05.086085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:05.086309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:05.086354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.086359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.086361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.086362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.086363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.086364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.086365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.086366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.086367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.086368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.086381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.086382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.086383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.086384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.086389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.086400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.086404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.086408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.086411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.086414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.086418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.086422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.086425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.086430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.086434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.086437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.086441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.086445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.086453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.086462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.086472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.086478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.086486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.086491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.086499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.086504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.086519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.086527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.086532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.086537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.086544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.086549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.086557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.086561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.086567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.086576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.086583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.086589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.086594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.086599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.086608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.086613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.086619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.086625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.086632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.086637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.086673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:05.090890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:05.091485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:05.091498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:05.091500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:05.091504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:05.091510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2691 [2:7556256933307109581:6075]
2025-10-01T14:16:05.091527Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:05.091542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:05.091549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:05.091553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:05.091555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:05.091570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:05.091578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:05.091583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:05.091629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.091635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.091637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.091640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:05.091643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:05.091705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:05.091710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.091720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.091728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.091742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:05.091756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684031793:7023], now have 1 active actors on pipe
2025-10-01T14:16:05.091759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684031524:2446], now have 1 active actors on pipe
2025-10-01T14:16:05.091770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.091772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.091774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.091784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:05.091796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:05.091810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:05.091813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:05.091833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.091834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:05.091836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:05.091838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:05.091838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:05.091843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:05.092171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2691
2025-10-01T14:16:05.092198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2691
2025-10-01T14:16:05.092328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.092337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.092365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:05.092372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:05.092376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:05.092381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:05.092389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:05.092399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:05.092422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:05.094962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.094979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.095000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:05.096684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2692 partition: 0 MaxSeqNo: 45 sessionId: src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0
2025-10-01T14:16:05.097347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6001c0b-580153c6-65912e28-be911b7c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:05.099936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Write session: try to update token
2025-10-01T14:16:05.099952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:05.133838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId: src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:05.136535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:05.137336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.137357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.137409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:05.142265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:05.142297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:05.142299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:05.142301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:05.142311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.142315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.142319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256933307109576:6075]
2025-10-01T14:16:05.137633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:05.142366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:05.142862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:05.142867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:05.142870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:05.145232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256935684031812:5610]
2025-10-01T14:16:05.145667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2691, pipe: [1:7556256935684031812:5610]
2025-10-01T14:16:05.148384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.148397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:05.148558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:05.309998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:05.310411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684031812:5610], now have 1 active actors on pipe
2025-10-01T14:16:05.318034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.318063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.318558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.318648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.318722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.318794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.318841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.318851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.318929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.319000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.319068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.319131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.319178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.319198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.319270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.319332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.319399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.319478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.319521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.319529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.319594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.319660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.319721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.319790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.319835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.319842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.319907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.319970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.320033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.320098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.320145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.320153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.320229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.320295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.320380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.320451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.320496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.320518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.320594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.320657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.320726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.320790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.320835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.320840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.320906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.320980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.321049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.321114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.321155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.321160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.321235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.321297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.321359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.321423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.321472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.321484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.321556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.321625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.321695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.321763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.321813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.321822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.323324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:05.323341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:05.323367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2692 reason: error at write: Disconnected sessionId: src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0
2025-10-01T14:16:05.323560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2692 sessionId: src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0 is DEAD
2025-10-01T14:16:05.323704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256935684031812:5610]
2025-10-01T14:16:05.323719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:05.324068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:05.324079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Write session will restart in 0.005120s
2025-10-01T14:16:05.324078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:05.324103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Write session: Do CDS request
2025-10-01T14:16:05.324112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:05.332103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:05.332208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:05.332223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2693
2025-10-01T14:16:05.332784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:05.332817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:05.332822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:05.332826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:05.333345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2693 sessionId:  describe result for acl check
2025-10-01T14:16:05.333373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:05.333375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:05.333377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:05.333381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256935684031852:7029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:05.333857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256935684031852:7029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:05.341929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256935684031852:7029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:05.348111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256935684031852:7029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:05.348128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256935684031852:7029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:05.348131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256935684031852:7029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:05.348141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:05.364945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:05.370163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:05.370424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:05.370436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:05.370449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:05.370512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:05.370558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256933307109894:6060]
2025-10-01T14:16:05.371136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:05.371429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:05.371479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:05.371799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:05.371863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.371878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.371879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.371881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.371882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.371883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.371885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.371886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.371887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.371888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.371889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.371890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.371891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.371892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.371899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.371908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.371912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.371915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.371918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.371922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.371925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.371929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.371933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.371937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.371941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.371944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.371948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.371952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.371959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.371966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.371972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.371978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.371982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.371987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.371991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.371996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.372002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.372011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.372021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.372032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.372036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.372041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.372045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.372049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.372053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.372057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.372063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.372072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.372077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.372086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.372090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.372096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.372104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.372108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.372113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.372122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.372156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:05.376816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:05.377444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:05.377450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:05.377452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:05.377456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:05.377464Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2692 [2:7556256933307109894:6060]
2025-10-01T14:16:05.377481Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:05.377498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:05.377501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:05.377504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:05.377506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:05.377522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:05.377527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:05.377534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:05.377593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.377595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.377596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.377600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:05.377602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:05.377673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:05.377676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.377685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.377695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.377710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:05.377725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.377727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.377730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.377742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:05.377758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:05.377778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:05.377781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:05.377792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:05.377794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:05.377795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:05.377814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.377817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:05.377851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:05.377918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684031945:7029], now have 1 active actors on pipe
2025-10-01T14:16:05.377924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684031837:2446], now have 1 active actors on pipe
2025-10-01T14:16:05.378188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2692
2025-10-01T14:16:05.378224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2692
2025-10-01T14:16:05.378859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.378871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.378896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:05.378913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:05.378916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:05.378918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:05.378926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:05.378934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:05.378947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:05.382321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.382334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.382362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:05.384826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cbf269-2177bed4-ada8b594-d96993a9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:05.382571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2693 partition: 0 MaxSeqNo: 45 sessionId: src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0
2025-10-01T14:16:05.387382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Write session: try to update token
2025-10-01T14:16:05.387400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:05.407472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:05.407494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:05.407497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:05.407499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:05.407509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.407514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.407517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256933307109889:6060]
2025-10-01T14:16:05.407568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:05.407580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.407583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:05.410441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId: src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:05.412827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:05.407726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:05.407751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:05.407756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:05.407763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:05.422659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256935684032121:5610]
2025-10-01T14:16:05.423000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2692, pipe: [1:7556256935684032121:5610]
2025-10-01T14:16:05.571984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:05.573033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.573044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.573069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684032121:5610], now have 1 active actors on pipe
2025-10-01T14:16:05.573947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256935684032121:5610]
2025-10-01T14:16:05.573991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:05.573994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:05.574585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:05.574598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Write session will restart in 0.009466s
2025-10-01T14:16:05.574627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Write session: Do CDS request
2025-10-01T14:16:05.574634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:05.575114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:05.574047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2693 reason: error at write: Disconnected sessionId: src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0
2025-10-01T14:16:05.574264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2693 sessionId: src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0 is DEAD
2025-10-01T14:16:05.574590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:05.587034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:05.590513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:05.590530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2694
2025-10-01T14:16:05.590770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:05.590797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:05.590802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:05.590807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:05.591262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2694 sessionId:  describe result for acl check
2025-10-01T14:16:05.591288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:05.591289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:05.591291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:05.591296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256935684032140:7042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:05.591815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256935684032140:7042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:05.604744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256935684032140:7042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:05.614851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256935684032140:7042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:05.614872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256935684032140:7042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:05.614876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256935684032140:7042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:05.614885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:05.650841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:05.651226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:05.651403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:05.651407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:05.651419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:05.651462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:05.651504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256933307110174:6058]
2025-10-01T14:16:05.652090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:05.652718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:05.652770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:05.653115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:05.653179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.653180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.653181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.653182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.653184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.653185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.653186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.653188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.653189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.653190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.653191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.653192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.653193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.653194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.653200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.653210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.653213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.653217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.653220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.653224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.653228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.653232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.653235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.653239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.653243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.653246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.653249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.653253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.653260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.653267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:05.653276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.653281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:05.653286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.653305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:05.653309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.653313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:05.653318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.653324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:05.653328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.653333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:05.653338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.653343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:05.653347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.653351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:05.653356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.653362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:05.653366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.653370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.653375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.653380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.653384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.653389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.653395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.653400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:05.653404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.653408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:05.653457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:05.660152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:05.660803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:05.660809Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:05.660812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:05.660816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:05.660823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2693 [2:7556256933307110174:6058]
2025-10-01T14:16:05.660841Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:05.660861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:05.660865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:05.660869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:05.660872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:05.660890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:05.660896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:05.660903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:05.660966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.660968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.660971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.660974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:05.660977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:05.661050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:05.661053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.661066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:05.661079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:05.661098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:05.661115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.661118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.661121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.661134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:05.661148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:05.661165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:05.661168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:05.661210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.661213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:05.661481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:05.661487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:05.661489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:05.661494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:05.662431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2693
2025-10-01T14:16:05.662474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2693
2025-10-01T14:16:05.663022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684032222:7042], now have 1 active actors on pipe
2025-10-01T14:16:05.663035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684032124:2446], now have 1 active actors on pipe
2025-10-01T14:16:05.663164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.663173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.663206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:05.663215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:05.663221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:05.663224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:05.663235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:05.663250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:05.663270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:05.663454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256935684032415:5610]
2025-10-01T14:16:05.663848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.663858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.663876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:05.664108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684032415:5610], now have 1 active actors on pipe
2025-10-01T14:16:05.664631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b5774e-64abe7b9-926498b8-ac9ca263_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:05.667325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Write session: try to update token
2025-10-01T14:16:05.667346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:05.664200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2694 partition: 0 MaxSeqNo: 45 sessionId: src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0
2025-10-01T14:16:05.670897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2693, pipe: [1:7556256935684032415:5610]
2025-10-01T14:16:05.701285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId: src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:05.703583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:05.703926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.703945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.703980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:05.706578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:05.739699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:05.739718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:05.739721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:05.739723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:05.739733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.739737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.739741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256933307110168:6058]
2025-10-01T14:16:05.739787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:05.739794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:05.739796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:05.739925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:05.745617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:05.745633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:05.745637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:05.967856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:05.988824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:05.988848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:05.989022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.989076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.989137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.989194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.989719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.989727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.989797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.989850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.989905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.989965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.990217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.990221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.990288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.990346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.990424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.990486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.990525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.990528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.990591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.990648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.990707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.990767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.990811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.990814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.990881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.990935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.990992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.991050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.991088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.991091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.991155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.991210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.991266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.991323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.991362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.991365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.991429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.991483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.991539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.991597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.991637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.991640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.991703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.991755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.991813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.991872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.991910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.991915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.991977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.992031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.992087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.992146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.992185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.992188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.992252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:05.992306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:05.992359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:05.992413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:05.992453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:05.992456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:05.994145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:05.994158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Write session will restart in 0.005049s
2025-10-01T14:16:05.994184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Write session: Do CDS request
2025-10-01T14:16:05.994190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:05.993772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:05.993786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:05.993812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2694 reason: error at write: Disconnected sessionId: src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0
2025-10-01T14:16:05.994019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2694 sessionId: src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0 is DEAD
2025-10-01T14:16:05.994143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:05.994177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256935684032415:5610]
2025-10-01T14:16:05.996312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:06.002961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:06.006591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:06.006606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2695
2025-10-01T14:16:06.007058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:06.007092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:06.007098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:06.007101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:06.007527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2695 sessionId:  describe result for acl check
2025-10-01T14:16:06.007558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:06.007560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:06.007561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:06.007566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256939978999764:7062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:06.008075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256939978999764:7062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:06.028074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256939978999764:7062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:06.042944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256939978999764:7062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:06.042966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256939978999764:7062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:06.042969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256939978999764:7062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:06.042979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:06.055941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:06.059320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:06.059602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:06.059607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:06.059620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:06.059693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:06.059731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256937602077776:6030]
2025-10-01T14:16:06.060289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:06.060767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:06.060814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:06.061125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:06.061191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.061192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.061193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.061194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.061195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.061196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.061197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.061198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.061199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.061200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.061201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.061202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.061204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.061205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.061210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.061218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.061221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.061224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.061228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.061230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.061233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.061237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.061240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.061244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.061247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.061250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.061253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.061256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.061263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.061269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.061275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.061279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.061282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.061287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.061290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.061294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.061298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.061302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.061306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.061310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.061315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.061319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.061322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.061326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.061330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.061335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.061338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.061342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.061346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.061351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.061355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.061359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.061363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.061367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.061371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.061376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.061414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:06.066611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:06.067226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:06.067232Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:06.067235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:06.067239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:06.067245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2694 [2:7556256937602077776:6030]
2025-10-01T14:16:06.067263Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:06.067282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:06.067286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:06.067289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:06.067291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:06.067308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:06.067314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:06.067320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:06.067381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.067383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.067385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.067389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:06.067392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:06.067463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:06.067466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.067477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.067487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.067502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:06.067518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.067521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.067523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.067536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:06.067552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:06.067566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:06.067569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:06.067603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.067606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:06.068501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2694
2025-10-01T14:16:06.068546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2694
2025-10-01T14:16:06.067834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:06.067841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:06.067843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:06.067848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:06.072252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000021:7062], now have 1 active actors on pipe
2025-10-01T14:16:06.072264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256935684032453:2446], now have 1 active actors on pipe
2025-10-01T14:16:06.072301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.072307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.072338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cff79e36-50805d71-86132927-5b009cc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:06.072347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:06.072353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:06.072355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:06.072367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:06.072382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:06.072400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:06.072765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.072773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.072789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:06.072928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2695 partition: 0 MaxSeqNo: 45 sessionId: src_id|cff79e36-50805d71-86132927-5b009cc3_0
2025-10-01T14:16:06.078480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7609695f-3c8cc05a-1ae8e86c-c5a80681_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cff79e36-50805d71-86132927-5b009cc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:06.081118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Write session: try to update token
2025-10-01T14:16:06.081136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:06.094709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256939979000038:5610]
2025-10-01T14:16:06.095500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2694, pipe: [1:7556256939979000038:5610]
2025-10-01T14:16:06.097141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000038:5610], now have 1 active actors on pipe
2025-10-01T14:16:06.097168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:06.097171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:06.097174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:06.097176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:06.097184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.097190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.097194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256937602077770:6030]
2025-10-01T14:16:06.097238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:06.097245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.097248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:06.097381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:06.097995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:06.098005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:06.098008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:06.120966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId: src_id|cff79e36-50805d71-86132927-5b009cc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:06.123531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:06.326668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:06.327444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.327465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.328960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:06.329015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256939979000038:5610]
2025-10-01T14:16:06.329033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:06.329037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:06.329087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2695 reason: error at write: Disconnected sessionId: src_id|cff79e36-50805d71-86132927-5b009cc3_0
2025-10-01T14:16:06.329270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2695 sessionId: src_id|cff79e36-50805d71-86132927-5b009cc3_0 is DEAD
2025-10-01T14:16:06.329053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:06.329561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:06.329568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Write session will restart in 0.009735s
2025-10-01T14:16:06.329592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Write session: Do CDS request
2025-10-01T14:16:06.329600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:06.342816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:06.346516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:06.346531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2696
2025-10-01T14:16:06.348131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:06.348171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:06.348176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:06.348179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:06.348657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2696 sessionId:  describe result for acl check
2025-10-01T14:16:06.348687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:06.348689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:06.348691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:06.348696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256939979000066:7081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:06.349221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256939979000066:7081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:06.362326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256939979000066:7081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:06.377480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256939979000066:7081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:06.377501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256939979000066:7081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:06.377503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256939979000066:7081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:06.377510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:06.401456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:06.409715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:06.409943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:06.409947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:06.409957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:06.410000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:06.410044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256937602078092:6032]
2025-10-01T14:16:06.410628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:06.411200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:06.411239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:06.411513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:06.411559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.411564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.411565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.411567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.411568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.411569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.411570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.411571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.411572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.411573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.411574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.411575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.411576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.411577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.411581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.411590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.411593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.411596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.411599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.411602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.411605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.411608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.411611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.411615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.411618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.411621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.411624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.411627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.411634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.411641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.411646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.411651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.411655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.411659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.411662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.411667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.411670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.411675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.411678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.411682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.411686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.411691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.411694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.411698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.411702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.411707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.411710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.411714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.411718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.411723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.411726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.411731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.411736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.411740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.411744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.411748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.411782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:06.415741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:06.416703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:06.416708Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:06.416710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:06.416714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:06.416720Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2695 [2:7556256937602078092:6032]
2025-10-01T14:16:06.416736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:06.416753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:06.416756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:06.416760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:06.416762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:06.416781Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:06.416789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:06.416796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:06.416860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.416862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.416863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.416867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:06.416870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:06.416935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:06.416937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.416947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.416956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.416970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:06.416985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.416987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.416989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.417000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:06.417012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:06.417024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:06.417026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:06.417053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.417055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:06.417833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2695
2025-10-01T14:16:06.417870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2695
2025-10-01T14:16:06.417242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:06.417248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:06.417249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:06.417254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:06.418207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000057:2446], now have 1 active actors on pipe
2025-10-01T14:16:06.418214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000159:7081], now have 1 active actors on pipe
2025-10-01T14:16:06.418231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.418236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.418262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:06.418269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:06.418273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:06.418276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:06.418286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:06.418296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:06.418309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:06.418699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.418712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.418735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:06.418990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2696 partition: 0 MaxSeqNo: 45 sessionId: src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0
2025-10-01T14:16:06.419373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff79e36-50805d71-86132927-5b009cc3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:06.422111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Write session: try to update token
2025-10-01T14:16:06.422128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:06.429173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256939979000345:5610]
2025-10-01T14:16:06.429557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000345:5610], now have 1 active actors on pipe
2025-10-01T14:16:06.429666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2695, pipe: [1:7556256939979000345:5610]
2025-10-01T14:16:06.441862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:06.441879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:06.441882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:06.441883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:06.441893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.441900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.441903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256937602078074:6032]
2025-10-01T14:16:06.441952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:06.441958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.441961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:06.442108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:06.443417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:06.443423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:06.443428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:06.466101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId: src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:06.469001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:06.602576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:06.603539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.603551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.607464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:06.607524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:06.607526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:06.607589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2696 reason: error at write: Disconnected sessionId: src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0
2025-10-01T14:16:06.607804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256939979000345:5610]
2025-10-01T14:16:06.607986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:06.607997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Write session will restart in 0.007369s
2025-10-01T14:16:06.608024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Write session: Do CDS request
2025-10-01T14:16:06.608030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:06.608252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2696 sessionId: src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0 is DEAD
2025-10-01T14:16:06.608029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:06.618956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:06.619291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:06.619308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2697
2025-10-01T14:16:06.619476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:06.619503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:06.619508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:06.619511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:06.623343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2697 sessionId:  describe result for acl check
2025-10-01T14:16:06.623389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:06.623391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:06.623392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:06.623398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256939979000379:7086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:06.623935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256939979000379:7086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:06.627453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256939979000379:7086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:06.633758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256939979000379:7086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:06.633774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256939979000379:7086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:06.633781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256939979000379:7086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:06.633789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:06.670437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:06.673262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:06.673495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:06.673498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:06.673509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:06.673553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:06.673587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256937602078375:6010]
2025-10-01T14:16:06.674132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:06.674715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:06.674772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:06.675076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:06.675144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.675145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.675145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.675147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.675148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.675149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.675150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.675151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.675153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.675154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.675155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.675156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.675157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.675158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.675163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.675172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.675175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.675179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.675182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.675186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.675189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.675193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.675196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.675199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.675203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.675206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.675209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.675213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.675221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.675228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:06.675234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.675239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:06.675243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.675247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:06.675251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.675255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:06.675259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.675264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:06.675268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.675273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:06.675277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.675281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:06.675284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.675288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:06.675293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.675297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:06.675314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.675318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.675322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.675329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.675333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.675338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.675342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.675347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:06.675351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.675355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:06.675392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:06.690924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:06.691724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:06.691734Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:06.691736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:06.691739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:06.691743Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2696 [2:7556256937602078375:6010]
2025-10-01T14:16:06.691757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:06.691771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:06.691773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:06.691776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:06.691777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:06.691791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:06.691795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:06.691799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:06.691842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.691844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.691845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.691848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:06.691850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:06.691905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:06.691907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.691915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:06.691920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:06.691930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:06.691941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.691943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.691946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.691953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:06.691963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:06.691972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:06.691973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:06.692003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.692005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:06.692067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:06.692068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:06.692071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:06.692074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:06.692311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000430:7086], now have 1 active actors on pipe
2025-10-01T14:16:06.692314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000355:2446], now have 1 active actors on pipe
2025-10-01T14:16:06.693059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2696
2025-10-01T14:16:06.693085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2696
2025-10-01T14:16:06.695215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.695229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.695262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:06.695272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:06.695277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:06.695281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:06.695292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:06.695306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:06.695328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:06.695795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:06.695802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:06.695817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:06.696335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caefdf06-63563f1a-34d9b56a-d84725c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:06.699160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Write session: try to update token
2025-10-01T14:16:06.699182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:06.695954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2697 partition: 0 MaxSeqNo: 45 sessionId: src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0
2025-10-01T14:16:06.708694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256939979000648:5610]
2025-10-01T14:16:06.709263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256939979000648:5610], now have 1 active actors on pipe
2025-10-01T14:16:06.709415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2696, pipe: [1:7556256939979000648:5610]
2025-10-01T14:16:06.754757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:06.754774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:06.754776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:06.754778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:06.754789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.754793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.754797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256937602078369:6010]
2025-10-01T14:16:06.754841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:06.754848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:06.754850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:06.754982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:06.759031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:06.759044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:06.759048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:06.760142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId: src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:06.762591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:07.009240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:07.010016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.010027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.011043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256939979000648:5610]
2025-10-01T14:16:07.011067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:07.011069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:07.011117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2697 reason: error at write: Disconnected sessionId: src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0
2025-10-01T14:16:07.011304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2697 sessionId: src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0 is DEAD
2025-10-01T14:16:07.011419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:07.011759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:07.011768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Write session will restart in 0.008234s
2025-10-01T14:16:07.011795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Write session: Do CDS request
2025-10-01T14:16:07.011802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:07.012712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:07.021285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:07.021562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:07.021575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2698
2025-10-01T14:16:07.021768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:07.021794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:07.021799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:07.021802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:07.022226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2698 sessionId:  describe result for acl check
2025-10-01T14:16:07.022251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:07.022253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:07.022254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:07.022260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256944273967992:7124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:07.022727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256944273967992:7124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:07.035044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256944273967992:7124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:07.044447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256944273967992:7124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:07.044462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256944273967992:7124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:07.044465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256944273967992:7124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:07.044474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:07.062113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:07.065156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:07.065353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:07.065356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:07.065366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:07.065405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:07.065441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256941897045980:6004]
2025-10-01T14:16:07.065986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:07.066352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:07.066423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:07.066850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:07.066911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.066912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.066913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.066914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.066915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.066916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.066917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.066918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.066919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.066920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.066921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.066922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.066923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.066924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.066929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.066937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.066940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.066943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.066946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.066949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.066952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.066955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.066959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.066962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.066965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.066968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.066971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.066974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.066982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.066988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.066994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.066999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.067002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.067006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.067009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.067013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.067017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.067021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.067025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.067029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.067033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.067037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.067040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.067044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.067048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.067052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.067055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.067060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.067063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.067067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.067071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.067075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.067079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.067082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.067086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.067090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.067122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:07.071531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:07.072633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:07.072638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:07.072640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:07.072643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:07.072649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2697 [2:7556256941897045980:6004]
2025-10-01T14:16:07.072664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:07.072680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:07.072683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:07.072686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:07.072688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:07.072703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:07.072708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:07.072714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:07.072769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.072773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.072774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.072777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:07.072780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:07.072839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:07.072841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.072850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.072858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.072870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:07.072885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.072887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.072888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.072898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:07.072911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:07.072922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:07.072924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:07.072952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.072953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:07.073192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:07.073197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:07.073199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:07.073203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:07.073790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2697
2025-10-01T14:16:07.073826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2697
2025-10-01T14:16:07.077188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273967977:2446], now have 1 active actors on pipe
2025-10-01T14:16:07.077199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968138:7124], now have 1 active actors on pipe
2025-10-01T14:16:07.077220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.077226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.077256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffd88589-5412f129-e948d92b-763333fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:07.077265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:07.077270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:07.077272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:07.077284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:07.077298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:07.077314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:07.077666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.077676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.077693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:07.077835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2698 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffd88589-5412f129-e948d92b-763333fb_0
2025-10-01T14:16:07.078247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ec61-79cd0e22-cb3cbb36-5ca6bfef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffd88589-5412f129-e948d92b-763333fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:07.080813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Write session: try to update token
2025-10-01T14:16:07.080833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:07.113837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256944273968266:5610]
2025-10-01T14:16:07.113082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:07.113101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:07.113104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:07.113105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:07.113116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.113121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.113126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256941897045974:6004]
2025-10-01T14:16:07.113170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:07.113177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.113179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:07.113632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:07.114927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:07.114936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:07.114939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:07.115315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2697, pipe: [1:7556256944273968266:5610]
2025-10-01T14:16:07.127493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId: src_id|ffd88589-5412f129-e948d92b-763333fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:07.130084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:07.296778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:07.297225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968266:5610], now have 1 active actors on pipe
2025-10-01T14:16:07.297251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.297257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.298473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:07.298481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Write session will restart in 0.008348s
2025-10-01T14:16:07.298507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Write session: Do CDS request
2025-10-01T14:16:07.298514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:07.298609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:07.297919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:07.297932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:07.297986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2698 reason: error at write: Disconnected sessionId: src_id|ffd88589-5412f129-e948d92b-763333fb_0
2025-10-01T14:16:07.298159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2698 sessionId: src_id|ffd88589-5412f129-e948d92b-763333fb_0 is DEAD
2025-10-01T14:16:07.298348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256944273968266:5610]
2025-10-01T14:16:07.298360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:07.314830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:07.318638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:07.318654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2699
2025-10-01T14:16:07.318802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:07.318828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:07.318832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:07.318836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:07.319233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2699 sessionId:  describe result for acl check
2025-10-01T14:16:07.319258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:07.319259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:07.319261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:07.319265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256944273968303:7150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:07.319706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256944273968303:7150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:07.343770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256944273968303:7150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:07.351372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256944273968303:7150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:07.351387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256944273968303:7150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:07.351390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256944273968303:7150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:07.351398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:07.364367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:07.367547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:07.367722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:07.367726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:07.367739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:07.367779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:07.367802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256941897046267:6000]
2025-10-01T14:16:07.368205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:07.368802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:07.368834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:07.369041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:07.369072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.369072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.369073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.369074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.369075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.369076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.369077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.369078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.369078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.369079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.369080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.369081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.369081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.369082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.369085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.369091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.369094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.369096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.369098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.369101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.369103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.369106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.369108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.369110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.369112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.369114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.369117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.369119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.369125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.369130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.369134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.369137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.369140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.369143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.369145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.369148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.369151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.369154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.369157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.369160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.369162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.369165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.369167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.369170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.369173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.369175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.369177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.369180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.369183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.369186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.369188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.369191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.369193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.369197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.369199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.369202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.369224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:07.373493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:07.374175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:07.374179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:07.374180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:07.374183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:07.374187Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2698 [2:7556256941897046267:6000]
2025-10-01T14:16:07.374199Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:07.374212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:07.374214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:07.374216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:07.374218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:07.374229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:07.374232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:07.374236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:07.374272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.374274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.374275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.374277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:07.374279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:07.374330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:07.374337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.374344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.374350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.374359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:07.374387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.374389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.374391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.374400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:07.374413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:07.374427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:07.374430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:07.374456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.374459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:07.374528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:07.374535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:07.374537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:07.374542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:07.374683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968485:7150], now have 1 active actors on pipe
2025-10-01T14:16:07.374689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968275:2446], now have 1 active actors on pipe
2025-10-01T14:16:07.375062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2698
2025-10-01T14:16:07.375091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2698
2025-10-01T14:16:07.375490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.375501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.375528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:07.375537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:07.375541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:07.375543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:07.375552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:07.375564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:07.375580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:07.378910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.378924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.378957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:07.379533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd88589-5412f129-e948d92b-763333fb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:07.382244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Write session: try to update token
2025-10-01T14:16:07.382261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:07.379137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2699 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0
2025-10-01T14:16:07.399308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256944273968578:5610]
2025-10-01T14:16:07.399877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968578:5610], now have 1 active actors on pipe
2025-10-01T14:16:07.399993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2698, pipe: [1:7556256944273968578:5610]
2025-10-01T14:16:07.405721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:07.405737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:07.405739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:07.405741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:07.405751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.405755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.405759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256941897046262:6000]
2025-10-01T14:16:07.405801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:07.405808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.405810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:07.406009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:07.413727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:07.413737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:07.413740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:07.422322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId: src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:07.424787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:07.616194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:07.616487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.616497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.617497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256944273968578:5610]
2025-10-01T14:16:07.617530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:07.617532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:07.617590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2699 reason: error at write: Disconnected sessionId: src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0
2025-10-01T14:16:07.617791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:07.617993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2699 sessionId: src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0 is DEAD
2025-10-01T14:16:07.618354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:07.618367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Write session will restart in 0.009781s
2025-10-01T14:16:07.618413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Write session: Do CDS request
2025-10-01T14:16:07.618419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:07.618550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:07.630859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:07.631286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:07.631304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2700
2025-10-01T14:16:07.631470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:07.631500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:07.631506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:07.631510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:07.638752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2700 sessionId:  describe result for acl check
2025-10-01T14:16:07.638796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:07.638798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:07.638802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:07.638808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256944273968602:7154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:07.639303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256944273968602:7154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:07.649714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256944273968602:7154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:07.656986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256944273968602:7154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:07.657005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256944273968602:7154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:07.657009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256944273968602:7154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:07.657018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:07.710936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:07.714188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:07.714535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:07.714545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:07.714556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:07.714606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:07.714639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256941897046586:5984]
2025-10-01T14:16:07.715243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:07.715594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:07.715631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:07.715941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:07.715985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.715991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.715993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.715994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.715995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.715996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.715997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.715998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.715999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.716000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.716002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.716003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.716004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.716005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.716010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.716019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.716023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.716027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.716030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.716034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.716038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.716041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.716045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.716049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.716052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.716056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.716060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.716063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.716070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.716078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:07.716083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.716088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:07.716092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.716097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:07.716101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.716106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:07.716111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.716115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:07.716121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.716125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:07.716129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.716134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:07.716137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.716142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:07.716146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.716151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:07.716155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.716160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.716164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.716169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.716173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.716179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.716183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.716188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:07.716192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.716197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:07.716234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:07.718491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256944273968882:5610]
2025-10-01T14:16:07.728828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:07.729390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:07.729395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:07.729398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:07.729401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:07.729409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2699 [2:7556256941897046586:5984]
2025-10-01T14:16:07.729425Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:07.729444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:07.729447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:07.729451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:07.729453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:07.729469Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:07.729475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:07.729482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:07.729536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.729538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.729540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.729544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:07.729546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:07.729618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:07.729621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.729632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:07.729643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:07.729659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:07.729674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.729677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.729679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.729690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:07.729704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:07.729719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:07.729721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:07.729761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.729763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:07.730077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:07.730083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:07.730085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:07.730090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:07.730311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968589:2446], now have 1 active actors on pipe
2025-10-01T14:16:07.730319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968882:5610], now have 1 active actors on pipe
2025-10-01T14:16:07.730321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256944273968656:7154], now have 1 active actors on pipe
2025-10-01T14:16:07.730650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2699
2025-10-01T14:16:07.730688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2699, pipe: [1:7556256944273968882:5610]
2025-10-01T14:16:07.730715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2699
2025-10-01T14:16:07.730874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.730888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.730916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:07.730924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:07.730929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:07.730931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:07.730941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:07.730950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:07.730965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:07.731244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.731250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.731263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:07.731791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad679add-84cdefeb-202da6e2-f82cd63c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:07.734353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Write session: try to update token
2025-10-01T14:16:07.734384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:07.731386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2700 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0
2025-10-01T14:16:07.767557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId: src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:07.770035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:07.770874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:07.770893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:07.770929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:07.771074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:07.801418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:07.801438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:07.801441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:07.801444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:07.801454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.801459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.801463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256941897046580:5984]
2025-10-01T14:16:07.801511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:07.801519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:07.801521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:07.801690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:07.802624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:07.802634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:07.802637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:08.075086Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:16:08.247280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:08.276793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.276824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.276996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.277053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.277111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.277203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.277530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.277535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.277877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.277935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.277993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.278054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.278093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.278096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.278159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.278215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.278270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.278328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.278367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.282420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.282511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.282602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.282657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.282715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.282757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.282760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.282871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.282954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.283009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.283065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.283103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.283107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.283220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.283277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.283336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.283395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.283454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.283458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.283530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.283586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.283656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.283718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.283845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.283850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.283919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.283977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.284036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.284104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.284162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.284165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.284229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.284286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.284344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.284405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.284446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.284449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.284525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.284696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.284753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.284809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.284851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.284854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.286468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:08.286523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256944273968882:5610]
2025-10-01T14:16:08.286544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:08.286547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:08.286572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2700 reason: error at write: Disconnected sessionId: src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0
2025-10-01T14:16:08.286749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2700 sessionId: src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0 is DEAD
2025-10-01T14:16:08.287146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:08.290019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:08.290039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Write session will restart in 0.009692s
2025-10-01T14:16:08.290066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Write session: Do CDS request
2025-10-01T14:16:08.290072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:08.303446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:08.306952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:08.306968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2701
2025-10-01T14:16:08.310554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:08.310601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:08.310607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:08.310610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:08.311203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2701 sessionId:  describe result for acl check
2025-10-01T14:16:08.311231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:08.311232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:08.311233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:08.311238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256948568936246:7178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:08.311643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256948568936246:7178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:08.328262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256948568936246:7178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:08.342986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256948568936246:7178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:08.343006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256948568936246:7178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:08.343009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256948568936246:7178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:08.343018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:08.386604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256948568936499:5610]
2025-10-01T14:16:08.395913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:08.399679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:08.399896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:08.399900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:08.399911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:08.399953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:08.399986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256946192014199:5971]
2025-10-01T14:16:08.400615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:08.401109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:08.401146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:08.401451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:08.401495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.401496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.401497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.401498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.401500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.401501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.401502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.401503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.401504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.401505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.401506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.401508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.401509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.401511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.401517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.401526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.401529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.401533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.401537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.401541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.401545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.401549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.401552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.401556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.401560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.401564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.401568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.401571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.401577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.401584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.401590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.401595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.401600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.401605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.401609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.401613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.401618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.401623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.401627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.401632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.401637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.401642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.401646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.401652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.401657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.401662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.401666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.401672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.401676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.401682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.401687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.401691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.401696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.401700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.401706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.401711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.401751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:08.406366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:08.407092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:08.407097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:08.407100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:08.407104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:08.407111Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2700 [2:7556256946192014199:5971]
2025-10-01T14:16:08.407126Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:08.407143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:08.407146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:08.407150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:08.407152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:08.407167Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:08.407172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:08.407178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:08.407229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.407231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.407233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.407237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:08.407239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:08.407655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:08.407658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.407670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.407682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.407700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:08.407717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.407720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.407722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.407734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:08.407750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:08.407764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:08.407767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:08.407795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.407797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:08.408629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2700
2025-10-01T14:16:08.408665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2700
2025-10-01T14:16:08.408681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2700, pipe: [1:7556256948568936499:5610]
2025-10-01T14:16:08.408031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:08.408036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:08.408039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:08.408043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:08.411255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256948568936221:2446], now have 1 active actors on pipe
2025-10-01T14:16:08.411271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256948568936322:7178], now have 1 active actors on pipe
2025-10-01T14:16:08.411275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256948568936499:5610], now have 1 active actors on pipe
2025-10-01T14:16:08.411301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.411306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.411336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:08.411345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:08.411350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:08.411353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:08.411364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:08.411378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:08.411395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:08.412412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.412421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.412441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:08.412645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2701 partition: 0 MaxSeqNo: 45 sessionId: src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0
2025-10-01T14:16:08.414702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed975ebe-9d2ce414-a57c0d41-4e2b608e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:08.417204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Write session: try to update token
2025-10-01T14:16:08.417221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:08.464252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId: src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:08.466786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:08.467699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.467722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.467760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:08.468786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:08.497449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:08.497468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:08.497470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:08.497472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:08.497480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.497484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.497488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256946192014193:5971]
2025-10-01T14:16:08.497533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:08.497540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.497542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:08.497667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:08.498313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:08.498321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:08.498325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:08.806354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:08.814899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.814924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.815091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.815148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.815214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.815276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.815319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.815325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.815394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.815450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.815510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.815573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.815619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.815622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.815684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.815741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.815802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.815858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.815894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.815897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.815956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.816012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.816069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.816164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.816201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.816204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.816264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.816317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.816371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.816427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.816464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.816466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.816544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.816607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.816667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.816730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.816769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.816771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.816836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.816895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.816959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.817020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.817059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.817062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.817128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.817187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.817246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.817307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.817347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.817349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.817418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.817475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.817534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.817592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.817631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.817634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.817700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:08.817760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:08.817822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:08.817884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:08.817943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:08.817949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:08.818942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:08.818955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:08.818981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2701 reason: error at write: Disconnected sessionId: src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0
2025-10-01T14:16:08.819173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2701 sessionId: src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0 is DEAD
2025-10-01T14:16:08.819296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256948568936499:5610]
2025-10-01T14:16:08.819309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:08.819336Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:16:08.819408Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 27 consumer shared/user session shared/user_1_27_4210109461526957791_v1 is DEAD
2025-10-01T14:16:08.819137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:08.821456Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256819719891390:5595] disconnected; active server actors: 1
2025-10-01T14:16:08.821466Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256819719891390:5595] client user disconnected session shared/user_1_27_4210109461526957791_v1
2025-10-01T14:16:08.822673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:08.822684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Write session will restart in 0.006758s
2025-10-01T14:16:08.822711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Write session: Do CDS request
2025-10-01T14:16:08.822718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:08.822942Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:16:08.823011Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:16:08.823017Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:16:08.823024Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005148s
2025-10-01T14:16:08.830751Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:16:08.831028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:08.831529Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:16:08.831541Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 28
2025-10-01T14:16:08.831565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:08.831570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2702
2025-10-01T14:16:08.831912Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 28 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:16:08.831969Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:16:08.832076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:08.832097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:08.832101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:08.832105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:08.832164Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 auth for : user
2025-10-01T14:16:08.832811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2702 sessionId:  describe result for acl check
2025-10-01T14:16:08.832846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:08.832848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:08.832849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:08.832854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256948568936571:7190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:08.833355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256948568936571:7190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:08.833518Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 Handle describe topics response
2025-10-01T14:16:08.833535Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 auth is DEAD
2025-10-01T14:16:08.833547Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:16:08.833821Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:16:08.834547Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_28_17894272478703188343_v1
2025-10-01T14:16:08.834944Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256948568936581:7192] connected; active server actors: 1
2025-10-01T14:16:08.838837Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256948568936581:7192] session shared/user_1_28_17894272478703188343_v1
2025-10-01T14:16:08.838861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:16:08.838875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:16:08.838882Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_28_17894272478703188343_v1" (Sender=[1:7556256948568936567:7192], Pipe=[1:7556256948568936581:7192], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:16:08.838887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:16:08.838905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:16:08.838915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_28_17894272478703188343_v1" (Sender=[1:7556256948568936567:7192], Pipe=[1:7556256948568936581:7192], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:16:08.838927Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_28_17894272478703188343_v1" sender [1:7556256948568936567:7192] lock partition 0 for ReadingSession "shared/user_1_28_17894272478703188343_v1" (Sender=[1:7556256948568936567:7192], Pipe=[1:7556256948568936581:7192], Partitions=[], ActiveFamilyCount=1) generation 1 step 28
2025-10-01T14:16:08.838937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:16:08.838942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:16:08.839195Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 28 Session: "shared/user_1_28_17894272478703188343_v1" ClientId: "user" PipeClient { RawX1: 7556256948568936581 RawX2: 4503603922344984 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:16:08.839222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:16:08.852945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256948568936571:7190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:08.875856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256948568936571:7190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:08.875875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256948568936571:7190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:08.875878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256948568936571:7190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:08.875889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:08.898996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:08.902915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:08.903120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:08.903123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:08.903133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:08.903176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:08.903213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256946192014530:5951]
2025-10-01T14:16:08.903785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:08.904191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:08.904228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:08.904494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:08.904557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.904558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.904559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.904560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.904561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.904562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.904563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.904564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.904565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.904566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.904567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.904568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.904569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.904570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.904574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.904583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.904586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.904588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.904591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.904594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.904598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.904601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.904604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.904607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.904610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.904613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.904616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.904619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.904625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.904632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:08.904637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.904641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:08.904645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.904649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:08.904652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.904657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:08.904661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.904665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:08.904668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.904673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:08.904676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.904681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:08.904684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.904688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:08.904692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.904696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:08.904700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.904703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.904708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.904711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.904715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.904719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.904723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.904727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:08.904731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.904736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:08.904768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:08.909139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:08.909925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:08.909930Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:08.909932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:08.909936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:08.909943Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2701 [2:7556256946192014530:5951]
2025-10-01T14:16:08.909959Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:08.909973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:08.909976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:08.909980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:08.909982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:08.909997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:08.910002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:08.910009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:08.910061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.910063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.910065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.910069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:08.910072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:08.910136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:08.910138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.910149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:08.910159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:08.910174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:08.910190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.910192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.910194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.910205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:08.910218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:08.910231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:08.910234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:08.910262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.910264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:08.910465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:08.910470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:08.910472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:08.910477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:08.911067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2701
2025-10-01T14:16:08.911101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2701, pipe: [1:7556256948568936600:7209]
2025-10-01T14:16:08.911118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2701
2025-10-01T14:16:08.914492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256948568936743:7190], now have 1 active actors on pipe
2025-10-01T14:16:08.914503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256948568936600:7209], now have 1 active actors on pipe
2025-10-01T14:16:08.914507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256948568936545:2446], now have 1 active actors on pipe
2025-10-01T14:16:08.914531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.914537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.914555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.914557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.914566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_28_17894272478703188343_v1 on pipe: [1:7556256948568936600:7209]
2025-10-01T14:16:08.914604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:08.914614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:08.914619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:08.914622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:08.914633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:08.914647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:08.914660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:08.914664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:08.914665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:08.914686Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_28_17894272478703188343_v1
2025-10-01T14:16:08.914689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:08.914718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:08.914734Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:16:08.914886Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_28_17894272478703188343_v1:1 with generation 2701
2025-10-01T14:16:08.915538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:08.915546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:08.915563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:08.915692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2702 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0
2025-10-01T14:16:08.918638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74299b1a-6e5fd97b-4fe54585-fa083a3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:08.921238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Write session: try to update token
2025-10-01T14:16:08.921261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:08.926757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:16:08.926792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:16:08.926802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:08.926805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:08.926808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:08.926818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:16:08.926832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:16:08.927142Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328168914 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:16:08.927161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:16:08.927193Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 sending to client partition status
2025-10-01T14:16:08.957640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId: src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:08.960185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:08.965279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:08.965299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:08.965302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:08.965304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:08.965314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.965319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.965323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256946192014524:5951]
2025-10-01T14:16:08.965370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:08.965377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:08.965380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:08.965515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:08.966508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:08.966519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:08.966523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:09.151474Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:09.151740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.151750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.152273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_28_17894272478703188343_v1
2025-10-01T14:16:09.152288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:09.152651Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_28_17894272478703188343_v1
2025-10-01T14:16:09.154904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:09.154948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:09.155017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2702 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0
2025-10-01T14:16:09.155188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2702 sessionId: src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0 is DEAD
2025-10-01T14:16:09.155436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256948568936600:7209]
2025-10-01T14:16:09.158697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:09.158707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Write session will restart in 0.005196s
2025-10-01T14:16:09.158732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Write session: Do CDS request
2025-10-01T14:16:09.158738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:09.167150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:09.170933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:09.170948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2703
2025-10-01T14:16:09.174499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:09.174548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:09.174552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:09.174557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:09.175357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2703 sessionId:  describe result for acl check
2025-10-01T14:16:09.175389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:09.175392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:09.175394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:09.175399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256952863904175:7216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:09.175863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256952863904175:7216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:09.184825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256952863904175:7216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:09.195528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256952863904175:7216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:09.195543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256952863904175:7216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:09.195546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256952863904175:7216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:09.195554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:09.258602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256952863904312:7209]
2025-10-01T14:16:09.304274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:09.311022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:09.311259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:09.311263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:09.311274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:09.311323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:09.311361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256950486982129:5941]
2025-10-01T14:16:09.312009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:09.316477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:09.316560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:09.316916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:09.316964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.316966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.316967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.316968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.316970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.316971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.316973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.316974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.316975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.316977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.316978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.316979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.316980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.316982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.316988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.316998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.317002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.317006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.317010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.317014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.317018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.317022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.317026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.317030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.317033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.317037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.317041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.317044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.317052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.317060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.317072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.317077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.317082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.317086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.317091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.317096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.317102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.317107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.317112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.317117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.317123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.317133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.317145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.317155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.317166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.317175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.317186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.317195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.317203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.317210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.317217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.317223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.317230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.317236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.317243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.317297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:09.327144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:09.327745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:09.327750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:09.327753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:09.327757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:09.327764Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2702 [2:7556256950486982129:5941]
2025-10-01T14:16:09.327780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:09.327797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:09.327801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:09.327804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:09.327807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:09.327824Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:09.327830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:09.327837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:09.327893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.327896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.327898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.327901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:09.327905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:09.327979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:09.327982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.327993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.328005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.328021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:09.328036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.328040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.328043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.328054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:09.328068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:09.328083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:09.328085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:09.328122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.328125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:09.328338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:09.328345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:09.328347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:09.328352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:09.328642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256952863904162:2446], now have 1 active actors on pipe
2025-10-01T14:16:09.328648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256952863904213:7216], now have 1 active actors on pipe
2025-10-01T14:16:09.328651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256952863904312:7209], now have 1 active actors on pipe
2025-10-01T14:16:09.334453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2702
2025-10-01T14:16:09.334501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2702
2025-10-01T14:16:09.334520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2702, pipe: [1:7556256952863904312:7209]
2025-10-01T14:16:09.334949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.334966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.334996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:09.335007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:09.335023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:09.335026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:09.335038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:09.335053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:09.335071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:09.342770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.342791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.342830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:09.343033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2703 partition: 0 MaxSeqNo: 45 sessionId: src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0
2025-10-01T14:16:09.343458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4371101-2d0fd162-702a8c6c-9acfc023_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:09.345968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Write session: try to update token
2025-10-01T14:16:09.345986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:09.363813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:09.363828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:09.363831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:09.363833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:09.363844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.363848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.363853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256950486982123:5941]
2025-10-01T14:16:09.363900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:09.363908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.363910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:09.364104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:09.366726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:09.366740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:09.366744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:09.382186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId: src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:09.384721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:09.624700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:09.625567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.625584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.626078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:09.627276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:09.627285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Write session will restart in 0.005780s
2025-10-01T14:16:09.627307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Write session: Do CDS request
2025-10-01T14:16:09.627313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:09.626908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:09.626983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0
2025-10-01T14:16:09.627151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2703 sessionId: src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0 is DEAD
2025-10-01T14:16:09.627272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256952863904312:7209]
2025-10-01T14:16:09.627284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:09.633942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:09.638463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:09.638485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2704
2025-10-01T14:16:09.640996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:09.641038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:09.641044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:09.641049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:09.643858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2704 sessionId:  describe result for acl check
2025-10-01T14:16:09.643910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:09.643912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:09.643914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:09.643920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256952863904525:7225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:09.644552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256952863904525:7225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:09.661013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256952863904525:7225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:09.670050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256952863904525:7225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:09.670068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256952863904525:7225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:09.670072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256952863904525:7225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:09.670080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:09.682162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:09.686102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:09.686312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:09.686317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:09.686327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:09.686388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:09.686421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256950486982424:5933]
2025-10-01T14:16:09.687043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:09.691176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:09.691266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:09.691650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:09.691745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.691747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.691748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.691751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.691752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.691754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.691755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.691756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.691757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.691759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.691760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.691761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.691762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.691763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.691771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.691780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.691783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.691787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.691791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.691794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.691798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.691801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.691805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.691808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.691812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.691815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.691818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.691822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.691830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.691838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:09.691844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.691850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:09.691853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.691862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:09.691866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.691873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:09.691877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.691882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:09.691885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.691890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:09.691895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.691899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:09.691903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.691907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:09.691915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.691921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:09.691925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.691929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.691933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.691937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.691941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.691945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.691949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.691953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:09.691957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.691961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:09.691998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:09.696998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:09.697687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:09.697692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:09.697695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:09.697701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:09.697710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2703 [2:7556256950486982424:5933]
2025-10-01T14:16:09.697729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:09.697745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:09.697749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:09.697753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:09.697755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:09.697771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:09.697777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:09.697783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:09.697838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.697840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.697841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.697844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:09.697847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:09.697921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:09.697924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.697936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:09.697948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:09.697965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:09.697983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.697985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.697987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.697998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:09.698013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:09.698029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:09.698032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:09.698066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.698069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:09.702653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:09.702662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:09.702664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:09.702671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:09.704094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256952863904700:7225], now have 1 active actors on pipe
2025-10-01T14:16:09.704106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256952863904492:2446], now have 1 active actors on pipe
2025-10-01T14:16:09.704122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.704130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.704161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9acf6555-f019e989-950c0c22-ad1743e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:09.704173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:09.704179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:09.704181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:09.704193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:09.704208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:09.704231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:09.704580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.704588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.704604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:09.705144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db11cf-750133b6-3849adeb-31fa2ea9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9acf6555-f019e989-950c0c22-ad1743e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:09.703493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2703
2025-10-01T14:16:09.703525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2703
2025-10-01T14:16:09.704750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2704 partition: 0 MaxSeqNo: 45 sessionId: src_id|9acf6555-f019e989-950c0c22-ad1743e0_0
2025-10-01T14:16:09.707784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Write session: try to update token
2025-10-01T14:16:09.707803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:09.728238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256952863904792:7209]
2025-10-01T14:16:09.728689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2703, pipe: [1:7556256952863904792:7209]
2025-10-01T14:16:09.729240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256952863904792:7209], now have 1 active actors on pipe
2025-10-01T14:16:09.756459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId: src_id|9acf6555-f019e989-950c0c22-ad1743e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:09.758809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:09.762879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:09.762904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:09.762944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:09.763157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:09.789228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:09.789248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:09.789251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:09.789253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:09.789263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.789268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.789274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256950486982418:5933]
2025-10-01T14:16:09.789321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:09.789328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:09.789330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:09.789495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:09.790562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:09.790572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:09.790576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:10.230991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:10.255976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.256005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.256181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.256238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.256299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.256367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.256410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.256415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.256485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.256561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.256618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.256677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.256719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.256722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.256788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.256843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.256900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.256954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.256991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.256996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.257060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.257117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.257170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.257249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.257293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.257296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.257355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.257410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.257467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.257524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.257566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.257569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.257635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.257692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.257751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.257813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.257858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.257860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.257927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.257984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.258047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.258120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.258178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.258181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.258247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.258335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.266469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.266560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.266612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.266618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.266695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.266755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.266814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.266877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.266935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.266939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.267008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:10.267068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:10.267133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:10.267196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:10.267236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:10.267239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:10.270583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:10.270883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256952863904792:7209]
2025-10-01T14:16:10.270913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:10.270915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:10.270940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2704 reason: error at write: Disconnected sessionId: src_id|9acf6555-f019e989-950c0c22-ad1743e0_0
2025-10-01T14:16:10.271117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2704 sessionId: src_id|9acf6555-f019e989-950c0c22-ad1743e0_0 is DEAD
2025-10-01T14:16:10.271234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:10.275530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:10.275540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Write session will restart in 0.007310s
2025-10-01T14:16:10.275566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Write session: Do CDS request
2025-10-01T14:16:10.275573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:10.286282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:10.290759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:10.290775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2705
2025-10-01T14:16:10.291075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:10.291101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:10.291106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:10.291110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:10.291672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2705 sessionId:  describe result for acl check
2025-10-01T14:16:10.291705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:10.291706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:10.291708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:10.291713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256957158872132:7250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:10.292189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256957158872132:7250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:10.305561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256957158872132:7250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:10.328593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256957158872132:7250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:10.328612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256957158872132:7250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:10.328616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256957158872132:7250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:10.328623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:10.374152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256957158872416:7209]
2025-10-01T14:16:10.379909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:10.386968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:10.387224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:10.387228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:10.387239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:10.387289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:10.387327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256954781950063:5884]
2025-10-01T14:16:10.387966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:10.394614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:10.394709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:10.395156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:10.395225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.395226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.395227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.395229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.395230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.395232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.395233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.395235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.395236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.395238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.395239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.395241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.395242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.395243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.395250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.395261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.395265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.395269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.395274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.395278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.395282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.395286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.395290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.395294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.395298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.395302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.395306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.395310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.395319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.395327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.395334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.395340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.395345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.395351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.395356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.395361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.395366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.395372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.395379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.395385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.395391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.395396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.395402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.395407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.395412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.395417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.395422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.395427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.395432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.395437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.395441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.395447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.395452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.395457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.395461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.395466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.395510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:10.406027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:10.406839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:10.406844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:10.406847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:10.406851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:10.406858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2704 [2:7556256954781950063:5884]
2025-10-01T14:16:10.406873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:10.406890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:10.406893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:10.406896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:10.406899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:10.406914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:10.406919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:10.406925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:10.406987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.406989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.406991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.406995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:10.406998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:10.407073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:10.407076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.407089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.407101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.407118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:10.407134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.407138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.407140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.407153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:10.407166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:10.407181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:10.407183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:10.407219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.407221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:10.410420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:10.410437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:10.410439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:10.410448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:10.411541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2704
2025-10-01T14:16:10.411582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2704
2025-10-01T14:16:10.411602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2704, pipe: [1:7556256957158872416:7209]
2025-10-01T14:16:10.414779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acf6555-f019e989-950c0c22-ad1743e0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:10.413622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256957158872103:2446], now have 1 active actors on pipe
2025-10-01T14:16:10.413646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256957158872267:7250], now have 1 active actors on pipe
2025-10-01T14:16:10.413650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256957158872416:7209], now have 1 active actors on pipe
2025-10-01T14:16:10.413784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.413791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.413829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:10.413839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:10.413845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:10.413848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:10.413861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:10.413877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:10.413898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:10.414165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.414169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.414184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:10.417619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Write session: try to update token
2025-10-01T14:16:10.417636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:10.414301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2705 partition: 0 MaxSeqNo: 45 sessionId: src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0
2025-10-01T14:16:10.461224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId: src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:10.463649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:10.464908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.464932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.464952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:10.464955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:10.464957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:10.464959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:10.464966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.464970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.464973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256954781950058:5884]
2025-10-01T14:16:10.465026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:10.465032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.465034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:10.465170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:10.466731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:10.466743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:10.466746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:10.658665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:10.659064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:10.662828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:10.662919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:10.662921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:10.662996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2705 reason: error at write: Disconnected sessionId: src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0
2025-10-01T14:16:10.663154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2705 sessionId: src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0 is DEAD
2025-10-01T14:16:10.663264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:10.663296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256957158872416:7209]
2025-10-01T14:16:10.667482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:10.667494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Write session will restart in 0.007758s
2025-10-01T14:16:10.667520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Write session: Do CDS request
2025-10-01T14:16:10.667526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:10.678856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:10.679151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:10.679165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2706
2025-10-01T14:16:10.679336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:10.679362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:10.679367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:10.679370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:10.680716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2706 sessionId:  describe result for acl check
2025-10-01T14:16:10.680742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:10.680744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:10.680745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:10.680750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256957158872456:7258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:10.681235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256957158872456:7258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:10.685559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256957158872456:7258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:10.691335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256957158872456:7258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:10.691351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256957158872456:7258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:10.691354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256957158872456:7258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:10.691363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:10.752996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:10.764783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256957158872742:7209]
2025-10-01T14:16:10.766340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:10.766634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:10.766639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:10.766654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:10.766729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:10.766770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256954781950363:10476]
2025-10-01T14:16:10.767371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:10.772905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:10.773002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:10.773388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:10.773475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.773476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.773477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.773479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.773481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.773482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.773483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.773485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.773486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.773487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.773488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.773490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.773491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.773492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.773501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.773511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.773515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.773519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.773524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.773527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.773532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.773535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.773539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.773544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.773547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.773551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.773555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.773559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.773569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.773577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:10.773584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.773590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:10.773596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.773601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:10.773606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.773612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:10.773616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.773621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:10.773626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.773632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:10.773636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.773642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:10.773647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.773652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:10.773657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.773662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:10.773667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.773672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.773677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.773683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.773688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.773693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.773698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.773703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:10.773711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.773716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:10.773755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:10.783948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:10.785153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:10.785161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:10.785165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:10.785169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:10.785177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2705 [2:7556256954781950363:10476]
2025-10-01T14:16:10.785193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:10.785212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:10.785216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:10.785220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:10.785222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:10.785240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:10.785245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:10.785252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:10.785314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.785316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.785318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.785321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:10.785323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:10.785402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:10.785405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.785417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:10.785426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:10.785441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:10.785457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.785459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.785461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.785474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:10.785489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:10.785504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:10.785507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:10.785546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.785549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:10.785994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:10.786002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:10.786005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:10.786010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:10.786805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2705, pipe: [1:7556256957158872742:7209]
2025-10-01T14:16:10.786849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2705
2025-10-01T14:16:10.786878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2705
2025-10-01T14:16:10.789533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256957158872446:2446], now have 1 active actors on pipe
2025-10-01T14:16:10.789550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256957158872495:7258], now have 1 active actors on pipe
2025-10-01T14:16:10.789553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256957158872742:7209], now have 1 active actors on pipe
2025-10-01T14:16:10.789576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.789582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.789613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:10.789624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:10.789631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:10.789634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:10.789649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:10.789666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:10.789684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:10.790012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.790022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.790039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:10.790173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2706 partition: 0 MaxSeqNo: 45 sessionId: src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0
2025-10-01T14:16:10.790603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac71745-4402f12b-9f21ca4b-397fcd96_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:10.793226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Write session: try to update token
2025-10-01T14:16:10.793248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:10.817727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId: src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:10.820306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:10.822358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:10.822393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:10.822431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:10.825888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:10.832520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:10.832539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:10.832542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:10.832544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:10.832554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.832559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.832563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256954781950357:10476]
2025-10-01T14:16:10.832610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:10.832617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:10.832619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:10.832803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:10.835086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:10.835097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:10.835103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:11.300891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:11.345354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.345384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.345573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.345646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.345714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.345776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.345828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.345833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.345909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.345974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.349609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:11.349655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:11.349658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:11.349683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2706 reason: error at write: Disconnected sessionId: src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0
2025-10-01T14:16:11.349875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2706 sessionId: src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0 is DEAD
2025-10-01T14:16:11.350011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256957158872742:7209]
2025-10-01T14:16:11.350245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:11.350253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Write session will restart in 0.008234s
2025-10-01T14:16:11.350279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Write session: Do CDS request
2025-10-01T14:16:11.350285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:11.346045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.346117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.346160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.346163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.346236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.346294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.346359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.346441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.346483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.346486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.346564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.346625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.346691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.346772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.346813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.346816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.346883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.346946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.347039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.347108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.347150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.347152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.347227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.347290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.347356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.347422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.347465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.347468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.347540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.347605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.347673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.347764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.347824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.347827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.347899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.347962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.348030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.348094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.348137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.348140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.348213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.348275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.348361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.348436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.348495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.348498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.348578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.348648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.348716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.348785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.348830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.348833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.350021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:11.362998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:11.366602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:11.366618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2707
2025-10-01T14:16:11.366821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:11.366849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:11.366854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:11.366858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:11.374789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2707 sessionId:  describe result for acl check
2025-10-01T14:16:11.374831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:11.374833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:11.374835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:11.374841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256961453840085:7279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:11.375346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256961453840085:7279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:11.385623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256961453840085:7279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:11.412121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256961453840085:7279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:11.412142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256961453840085:7279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:11.412147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256961453840085:7279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:11.412156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:11.450890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256961453840312:7209]
2025-10-01T14:16:11.480952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:11.488707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:11.488968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:11.488973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:11.488986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:11.489049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:11.489086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256959076918004:10451]
2025-10-01T14:16:11.489716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:11.490136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:11.490180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:11.490506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:11.490573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.490574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.490575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.490576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.490577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.490578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.490579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.490580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.490582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.490582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.490584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.490585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.490586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.490587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.490592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.490601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.490604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.490607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.490610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.490613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.490616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.490619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.490622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.490625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.490628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.490631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.490634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.490637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.490644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.490652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.490657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.490662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.490669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.490674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.490677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.490682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.490688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.490692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.490696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.490700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.490704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.490709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.490712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.490717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.490722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.490727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.490731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.490735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.490740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.490744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.490747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.490752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.490757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.490761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.490765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.490769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.490808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:11.499597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2706, pipe: [1:7556256961453840312:7209]
2025-10-01T14:16:11.499636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2706
2025-10-01T14:16:11.499657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2706
2025-10-01T14:16:11.497609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:11.498429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:11.498434Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:11.498436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:11.498440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:11.498447Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2706 [2:7556256959076918004:10451]
2025-10-01T14:16:11.498464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:11.498479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:11.498482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:11.498486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:11.498488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:11.498505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:11.498512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:11.498517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:11.498578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.498580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.498582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.498586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:11.498589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:11.498658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:11.498660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.498671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.498681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.498696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:11.498713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.498715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.498717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.498730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:11.498743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:11.498757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:11.498759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:11.498792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.498794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:11.498909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:11.498911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:11.498912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:11.498918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:11.500034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256961453840312:7209], now have 1 active actors on pipe
2025-10-01T14:16:11.500042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256961453840166:7279], now have 1 active actors on pipe
2025-10-01T14:16:11.500046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256961453840072:2446], now have 1 active actors on pipe
2025-10-01T14:16:11.500059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.500064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.500091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:11.500098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:11.500103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:11.500105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:11.500116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:11.500127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:11.500143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:11.500944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2707 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0
2025-10-01T14:16:11.501392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499e30b-90cd20d1-f7702dc2-1fa61bbf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:11.500793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.500805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.500826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:11.504350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Write session: try to update token
2025-10-01T14:16:11.504371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:11.537766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId: src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:11.540518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:11.541072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.541094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.541131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:11.546949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:11.576669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:11.576689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:11.576692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:11.576693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:11.576703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.576708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.576712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256959076917999:10451]
2025-10-01T14:16:11.576769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:11.576768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:11.576775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:11.576776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.576779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:11.576780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:11.576941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:11.779963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:11.803025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.803054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.803239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.803305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.803374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.803442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.803486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.803492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.803569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.803636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.803701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.803781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.803827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.803830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.803905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.803970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.804037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.804103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.804143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.804147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.804228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.804299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.804365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.804433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.804477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.804480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.804571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.804640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.804709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.804777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.804821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.804824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.804905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.804970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.805033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.805098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.805140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.805144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.805214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.805272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.805340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.805403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.805445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.805450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.805516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.805578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.805643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.805708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.805749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.805752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.805820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.805877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.805939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.806000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.806039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.806042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.806103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:11.806162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:11.806219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:11.806277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:11.806316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:11.806319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:11.808563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:11.810967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256961453840312:7209]
2025-10-01T14:16:11.811001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:11.811044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0
2025-10-01T14:16:11.811256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2707 sessionId: src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0 is DEAD
2025-10-01T14:16:11.811574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:11.814467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:11.814481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Write session will restart in 0.005401s
2025-10-01T14:16:11.814511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Write session: Do CDS request
2025-10-01T14:16:11.814517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:11.830576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:11.830958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:11.830977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2708
2025-10-01T14:16:11.831170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:11.831199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:11.831204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:11.831208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:11.832859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2708 sessionId:  describe result for acl check
2025-10-01T14:16:11.832888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:11.832891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:11.832892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:11.832898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256961453840438:7304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:11.833418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256961453840438:7304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:11.844854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256961453840438:7304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:11.855580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256961453840438:7304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:11.855600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256961453840438:7304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:11.855603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256961453840438:7304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:11.855612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:11.890468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:11.898033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:11.898300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:11.898304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:11.898317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:11.898398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:11.898436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256959076918309:10437]
2025-10-01T14:16:11.899011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:11.901049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:11.901123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:11.901514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:11.901586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.901587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.901589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.901590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.901591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.901593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.901594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.901595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.901596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.901598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.901600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.901601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.901602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.901603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.901612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.901623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.901627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.901631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.901635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.901639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.901643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.901647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.901651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.901656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.901659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.901664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.901668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.901672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.901683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.901694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:11.901702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.901709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:11.901718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.901725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:11.901730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.901735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:11.901740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.901745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:11.901750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.901755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:11.901761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.901767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:11.901771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.901777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:11.901782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.901788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:11.901792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.901797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.901802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.901808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.901812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.901818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.901822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.901828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:11.901832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.901838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:11.901878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:11.907347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:11.908495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:11.908526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:11.908528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:11.908533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:11.908541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2707 [2:7556256959076918309:10437]
2025-10-01T14:16:11.908559Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:11.908577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:11.908580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:11.908584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:11.908586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:11.908605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:11.908611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:11.908617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:11.908688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.908690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.908692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.908696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:11.908698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:11.908778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:11.908781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.908794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:11.908806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:11.908823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:11.908841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.908843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.908846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.908862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:11.908877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:11.908893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:11.908896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:11.908937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.908939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:11.909096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:11.909098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:11.909100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:11.909105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:11.909622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2707
2025-10-01T14:16:11.909660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2707
2025-10-01T14:16:11.909897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256961453840533:7304], now have 1 active actors on pipe
2025-10-01T14:16:11.909908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256961453840413:2446], now have 1 active actors on pipe
2025-10-01T14:16:11.909923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.909929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.909963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:11.909971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:11.909977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:11.909979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:11.909991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:11.910002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:11.910020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:11.910595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2708 partition: 0 MaxSeqNo: 45 sessionId: src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0
2025-10-01T14:16:11.911072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a103583-308c99d9-9d68e708-ce38ba7c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:11.913840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Write session: try to update token
2025-10-01T14:16:11.913858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:11.910432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:11.910440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:11.910460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:11.917545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256961453840711:7209]
2025-10-01T14:16:11.918884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256961453840711:7209], now have 1 active actors on pipe
2025-10-01T14:16:11.918995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2707, pipe: [1:7556256961453840711:7209]
2025-10-01T14:16:11.943267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId: src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:11.945812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:11.944017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:11.944039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:11.944042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:11.944044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:11.944054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.944060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.944064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256959076918304:10437]
2025-10-01T14:16:11.944118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:11.944125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:11.944127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:11.944274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:11.946979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:11.946990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:11.946994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:12.242559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:12.243118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.243130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.243958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:12.244001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:12.244004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:12.244069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2708 reason: error at write: Disconnected sessionId: src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0
2025-10-01T14:16:12.244265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2708 sessionId: src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0 is DEAD
2025-10-01T14:16:12.244447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256961453840711:7209]
2025-10-01T14:16:12.246638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:12.246651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Write session will restart in 0.006903s
2025-10-01T14:16:12.246676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Write session: Do CDS request
2025-10-01T14:16:12.246683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:12.246629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:12.259827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:12.262958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:12.262974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2709
2025-10-01T14:16:12.263181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:12.263213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:12.263219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:12.263223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:12.265087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2709 sessionId:  describe result for acl check
2025-10-01T14:16:12.265118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:12.265119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:12.265121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:12.265126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256965748808076:7329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:12.265661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256965748808076:7329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:12.283534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256965748808076:7329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:12.299723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256965748808076:7329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:12.299740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256965748808076:7329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:12.299745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256965748808076:7329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:12.299754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:12.309811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:12.310206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:12.310415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:12.310419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:12.310432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:12.310479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:12.310517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256963371885945:10430]
2025-10-01T14:16:12.311184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:12.313139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:12.313207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:12.313581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:12.313634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.313635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.313637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.313638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.313639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.313641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.313642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.313643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.313644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.313646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.313647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.313649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.313650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.313652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.313659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.313669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.313673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.313677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.313681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.313685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.313689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.313693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.313696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.313701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.313705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.313708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.313712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.313716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.313724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.313733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.313739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.313745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.313750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.313755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.313760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.313765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.313770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.313775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.313780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.313785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.313790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.313797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.313801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.313806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.313813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.313818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.313823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.313828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.313833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.313839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.313843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.313849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.313853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.313859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.313863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.313868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.313911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:12.319152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:12.319784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:12.319790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:12.319794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:12.319798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:12.319806Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2708 [2:7556256963371885945:10430]
2025-10-01T14:16:12.319824Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:12.319844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:12.319847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:12.319851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:12.319853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:12.319874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:12.319880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:12.319886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:12.319950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.319952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.319954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.319957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:12.319961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:12.320031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:12.320033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.320044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.320054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.320069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:12.320085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.320088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.320090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.320102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:12.320116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:12.320129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:12.320132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:12.320169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.320171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:12.320411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:12.320417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:12.320419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:12.320424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:12.321144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2708
2025-10-01T14:16:12.321183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2708
2025-10-01T14:16:12.321346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808305:7329], now have 1 active actors on pipe
2025-10-01T14:16:12.321356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808024:2446], now have 1 active actors on pipe
2025-10-01T14:16:12.321375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.321380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.321409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cea18d7-15778cf7-253e8065-cef759a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:12.321418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:12.321434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:12.321437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:12.321448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:12.321461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:12.321479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:12.322931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83516c24-20a0b8d4-567f9c6a-ef5ae05_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6cea18d7-15778cf7-253e8065-cef759a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:12.322529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2709 partition: 0 MaxSeqNo: 45 sessionId: src_id|6cea18d7-15778cf7-253e8065-cef759a1_0
2025-10-01T14:16:12.322327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.322337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.322357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:12.325582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Write session: try to update token
2025-10-01T14:16:12.325600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:12.345125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:12.345147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:12.345150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:12.345151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:12.345161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.345166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.345171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256963371885939:10430]
2025-10-01T14:16:12.345221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:12.345229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.345232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:12.345384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:12.346411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:12.346419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:12.346426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:12.349010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256965748808327:7209]
2025-10-01T14:16:12.349452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2708, pipe: [1:7556256965748808327:7209]
2025-10-01T14:16:12.349661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId: src_id|6cea18d7-15778cf7-253e8065-cef759a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:12.352231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:12.527018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:12.527427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808327:7209], now have 1 active actors on pipe
2025-10-01T14:16:12.527456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.527463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.532446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:12.532533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256965748808327:7209]
2025-10-01T14:16:12.532559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:12.532562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:12.532642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2709 reason: error at write: Disconnected sessionId: src_id|6cea18d7-15778cf7-253e8065-cef759a1_0
2025-10-01T14:16:12.532886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2709 sessionId: src_id|6cea18d7-15778cf7-253e8065-cef759a1_0 is DEAD
2025-10-01T14:16:12.533059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:12.535747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:12.535759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Write session will restart in 0.009137s
2025-10-01T14:16:12.535786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Write session: Do CDS request
2025-10-01T14:16:12.535792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:12.546835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:12.549654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:12.549668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2710
2025-10-01T14:16:12.549896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:12.549939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:12.549944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:12.549948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:12.550655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2710 sessionId:  describe result for acl check
2025-10-01T14:16:12.550690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:12.550694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:12.550695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:12.550701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256965748808402:7330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:12.551209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256965748808402:7330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:12.561872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256965748808402:7330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:12.574973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256965748808402:7330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:12.574989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256965748808402:7330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:12.574992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256965748808402:7330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:12.575001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:12.576563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:12.581687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:12.581908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:12.581918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:12.581930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:12.581978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:12.582013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256963371886245:10423]
2025-10-01T14:16:12.582574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:12.582965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:12.583007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:12.583221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:12.583251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.583251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.583252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.583253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.583253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.583254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.583255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.583256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.583257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.583257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.583258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.583259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.583260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.583260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.583263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.583269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.583271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.583273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.583275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.583277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.583279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.583281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.583283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.583286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.583288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.583290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.583292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.583294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.583300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.583305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.583308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.583311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.583314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.583316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.583318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.583321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.583326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.583329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.583331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.583334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.583336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.583339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.583341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.583344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.583347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.583349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.583352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.583354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.583357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.583360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.583362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.583365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.583367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.583370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.583372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.583375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.583393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:12.588071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:12.589241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:12.589246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:12.589249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:12.589252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:12.589258Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2709 [2:7556256963371886245:10423]
2025-10-01T14:16:12.589274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:12.589290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:12.589293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:12.589297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:12.589299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:12.589315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:12.589320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:12.589326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:12.589383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.589385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.589388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.589391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:12.589394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:12.589464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:12.589466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.589476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.589486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.589501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:12.589516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.589518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.589520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.589533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:12.589546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:12.589558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:12.589561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:12.589592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.589594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:12.589877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:12.589883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:12.589885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:12.589889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:12.590211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2709
2025-10-01T14:16:12.590211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2709
2025-10-01T14:16:12.593439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808632:7330], now have 1 active actors on pipe
2025-10-01T14:16:12.593452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808342:2446], now have 1 active actors on pipe
2025-10-01T14:16:12.593473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.593480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.593515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a171c3e8-44868377-c932db7f-47e3f362_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:12.593527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:12.593533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:12.593535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:12.593546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:12.593563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:12.593582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:12.595927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.595940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.595969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:12.596140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2710 partition: 0 MaxSeqNo: 45 sessionId: src_id|a171c3e8-44868377-c932db7f-47e3f362_0
2025-10-01T14:16:12.598905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea18d7-15778cf7-253e8065-cef759a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a171c3e8-44868377-c932db7f-47e3f362_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:12.601480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Write session: try to update token
2025-10-01T14:16:12.601499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:12.615438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:12.615452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:12.615455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:12.615457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:12.615467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.615471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.615476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256963371886238:10423]
2025-10-01T14:16:12.615521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:12.615528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.615530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:12.615667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:12.615668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:12.615674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:12.615677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:12.636066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256965748808664:7209]
2025-10-01T14:16:12.636101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId: src_id|a171c3e8-44868377-c932db7f-47e3f362_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:12.638679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:12.640018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2709, pipe: [1:7556256965748808664:7209]
2025-10-01T14:16:12.795205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:12.795747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.795757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.795780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808664:7209], now have 1 active actors on pipe
2025-10-01T14:16:12.801664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:12.801745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2710 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a171c3e8-44868377-c932db7f-47e3f362_0
2025-10-01T14:16:12.801944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2710 sessionId: src_id|a171c3e8-44868377-c932db7f-47e3f362_0 is DEAD
2025-10-01T14:16:12.802084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:12.802117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256965748808664:7209]
2025-10-01T14:16:12.798952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:12.804328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:12.804341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Write session will restart in 0.007329s
2025-10-01T14:16:12.804366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Write session: Do CDS request
2025-10-01T14:16:12.804371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:12.812902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:12.814644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:12.814658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2711
2025-10-01T14:16:12.818551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:12.818596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:12.818601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:12.818605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:12.818995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2711 sessionId:  describe result for acl check
2025-10-01T14:16:12.819020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:12.819024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:12.819025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:12.819030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256965748808699:7362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:12.819520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256965748808699:7362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:12.825254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256965748808699:7362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:12.831157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256965748808699:7362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:12.831174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256965748808699:7362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:12.831177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256965748808699:7362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:12.831185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:12.847742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:12.851038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:12.851269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:12.851273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:12.851285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:12.851337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:12.851373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256963371886549:10418]
2025-10-01T14:16:12.852377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:12.852862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:12.852913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:12.853230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:12.853278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.853279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.853280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.853282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.853283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.853284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.853285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.853286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.853288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.853289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.853290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.853291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.853292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.853294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.853299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.853309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.853313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.853317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.853321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.853325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.853329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.853333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.853337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.853342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.853346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.853350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.853353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.853357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.853364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.853371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:12.853378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.853383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:12.853388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.853394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:12.853400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.853406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:12.853410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.853416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:12.853420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.853425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:12.853430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.853436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:12.853440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.853445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:12.853450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.853455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:12.853461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.853466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.853471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.853476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.853480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.853485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.853490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.853495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:12.853500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.853505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:12.853544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:12.858118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:12.859107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:12.859112Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:12.859114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:12.859118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:12.859125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2710 [2:7556256963371886549:10418]
2025-10-01T14:16:12.859140Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:12.859158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:12.859161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:12.859165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:12.859167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:12.859183Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:12.859189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:12.859195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:12.859260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.859262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.859264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.859268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:12.859270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:12.859340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:12.859343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.859356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:12.859367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:12.859381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:12.859397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.859400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.859402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.859414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:12.859428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:12.859442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:12.859444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:12.859476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.859479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:12.859681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:12.859687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:12.859689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:12.859694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:12.862480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2710
2025-10-01T14:16:12.862516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2710
2025-10-01T14:16:12.863892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808794:7362], now have 1 active actors on pipe
2025-10-01T14:16:12.863914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808683:2446], now have 1 active actors on pipe
2025-10-01T14:16:12.863931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.863938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.863972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a31efae0-4d2ba959-6f25f602-648c3750_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:12.863984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:12.863990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:12.863993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:12.864004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:12.864019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:12.864038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:12.864359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.864366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.864379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:12.864517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2711 partition: 0 MaxSeqNo: 45 sessionId: src_id|a31efae0-4d2ba959-6f25f602-648c3750_0
2025-10-01T14:16:12.866632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171c3e8-44868377-c932db7f-47e3f362_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a31efae0-4d2ba959-6f25f602-648c3750_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:12.869269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Write session: try to update token
2025-10-01T14:16:12.869287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:12.885325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId: src_id|a31efae0-4d2ba959-6f25f602-648c3750_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:12.887768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:12.888070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:12.888088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:12.888121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:12.888703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:12.892161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:12.892180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:12.892182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:12.892184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:12.892192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.892196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.892200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256963371886544:10418]
2025-10-01T14:16:12.892243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:12.892249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:12.892251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:12.892380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:12.894493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:12.894504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:12.894507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:12.902431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256965748808988:7209]
2025-10-01T14:16:12.906434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2710, pipe: [1:7556256965748808988:7209]
2025-10-01T14:16:13.041265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:13.041873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256965748808988:7209], now have 1 active actors on pipe
2025-10-01T14:16:13.049704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.049728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.049891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.049948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.050008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.050069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.050113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.050117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.050185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.050238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.050295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.050358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.053409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:13.053425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:13.053448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2711 reason: error at write: Disconnected sessionId: src_id|a31efae0-4d2ba959-6f25f602-648c3750_0
2025-10-01T14:16:13.053601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:13.053636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2711 sessionId: src_id|a31efae0-4d2ba959-6f25f602-648c3750_0 is DEAD
2025-10-01T14:16:13.053649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256965748808988:7209]
2025-10-01T14:16:13.050533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.050542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.050612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.050663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.050716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.050771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.050806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.050809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.050868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.050921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.050972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.051025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.051061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.051063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.051120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.051171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.051224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.051279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.051317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.051320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.051385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.051440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.051500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.051558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.051597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.051600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.051689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.051745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.051807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.051866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.051907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.051910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.051971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.052027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.052086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.052143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.052189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.052194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.052259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.052313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.052372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.052428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.052466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.052470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.052543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:13.052595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:13.052653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:13.052714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:13.052756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:13.052759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:13.053933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:13.058496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:13.058509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Write session will restart in 0.005327s
2025-10-01T14:16:13.058536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Write session: Do CDS request
2025-10-01T14:16:13.058542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:13.066270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.067881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:13.067896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2712
2025-10-01T14:16:13.068131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.068159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:13.068164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:13.068169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:13.070935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2712 sessionId:  describe result for acl check
2025-10-01T14:16:13.070964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:13.070966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:13.070967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:13.070973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256970043776305:7374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:13.071458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256970043776305:7374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:13.078945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256970043776305:7374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:13.088268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256970043776305:7374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:13.088285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256970043776305:7374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:13.088288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256970043776305:7374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:13.088296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:13.115938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:13.121065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:13.121402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:13.121427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:13.121452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:13.121555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:13.121610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256967666854188:10413]
2025-10-01T14:16:13.122225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:13.122584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:13.122634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:13.122960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:13.123014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.123015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.123016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.123017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.123019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.123020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.123021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.123023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.123024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.123025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.123026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.123027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.123029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.123030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.123035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.123045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.123050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.123054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.123058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.123062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.123066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.123070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.123073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.123078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.123081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.123085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.123089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.123093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.123100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.123108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.123114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.123120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.123127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.123133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.123137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.123142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.123147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.123152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.123156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.123161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.123165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.123170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.123174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.123179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.123183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.123188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.123192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.123197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.123201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.123207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.123211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.123216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.123222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.123227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.123230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.123235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.123272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:13.129643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2711
2025-10-01T14:16:13.129685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2711
2025-10-01T14:16:13.128584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:13.129191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:13.129196Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:13.129200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:13.129203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:13.129211Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2711 [2:7556256967666854188:10413]
2025-10-01T14:16:13.129227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:13.129244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:13.129248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:13.129262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:13.129265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:13.129281Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:13.129287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:13.129293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:13.129351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.129353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.129355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.129358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:13.129360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:13.129430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:13.129433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.129874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.129887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.129906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:13.129926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776418:7374], now have 1 active actors on pipe
2025-10-01T14:16:13.129929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776289:2446], now have 1 active actors on pipe
2025-10-01T14:16:13.129945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.129950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.129972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.129974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.129976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.129991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:13.130006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:13.130021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:13.130023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:13.130024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:13.130027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:13.130029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:13.130038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|964788f8-1eb564b1-5c672da8-e01558bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:13.130045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:13.130049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:13.130052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:13.130060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:13.130068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:13.130103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.130111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:13.130121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:13.130122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:13.133580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.133594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.133624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:13.133768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2712 partition: 0 MaxSeqNo: 45 sessionId: src_id|964788f8-1eb564b1-5c672da8-e01558bb_0
2025-10-01T14:16:13.134193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31efae0-4d2ba959-6f25f602-648c3750_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|964788f8-1eb564b1-5c672da8-e01558bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:13.137235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Write session: try to update token
2025-10-01T14:16:13.137254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:13.154665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776596:7209], now have 1 active actors on pipe
2025-10-01T14:16:13.154240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256970043776596:7209]
2025-10-01T14:16:13.159590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2711, pipe: [1:7556256970043776596:7209]
2025-10-01T14:16:13.163305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId: src_id|964788f8-1eb564b1-5c672da8-e01558bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:13.165940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:13.161690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:13.161705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:13.161707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:13.161709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:13.161719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.161724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.161728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256967666854183:10413]
2025-10-01T14:16:13.161780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:13.161787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.161789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:13.161934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:13.166529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:13.166542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:13.166545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:13.343147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:13.343732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.343741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.344454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256970043776596:7209]
2025-10-01T14:16:13.344489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:13.344491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:13.344189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:13.345192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:13.345203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Write session will restart in 0.008827s
2025-10-01T14:16:13.345227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Write session: Do CDS request
2025-10-01T14:16:13.345235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:13.344555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2712 reason: error at write: Disconnected sessionId: src_id|964788f8-1eb564b1-5c672da8-e01558bb_0
2025-10-01T14:16:13.344733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2712 sessionId: src_id|964788f8-1eb564b1-5c672da8-e01558bb_0 is DEAD
2025-10-01T14:16:13.344844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:13.354852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.362490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:13.362509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2713
2025-10-01T14:16:13.363219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.363251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:13.363256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:13.363259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:13.365943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2713 sessionId:  describe result for acl check
2025-10-01T14:16:13.365978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:13.365984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:13.365986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:13.365992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256970043776629:7396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:13.366500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256970043776629:7396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:13.383371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256970043776629:7396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:13.399646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256970043776629:7396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:13.399664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256970043776629:7396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:13.399668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256970043776629:7396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:13.399677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:13.432197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:13.446669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256970043776911:7209]
2025-10-01T14:16:13.446997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:13.447202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:13.447206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:13.447218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:13.447259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:13.447287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256967666854491:10391]
2025-10-01T14:16:13.447740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:13.454586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:13.454687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:13.455052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:13.455115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.455116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.455117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.455118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.455120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.455121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.455123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.455125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.455126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.455127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.455129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.455130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.455131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.455133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.455139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.455150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.455154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.455158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.455162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.455167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.455171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.455175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.455178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.455182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.455186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.455189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.455192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.455196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.455205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.455214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.455221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.455227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.455232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.455237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.455242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.455247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.455252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.455258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.455263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.455268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.455273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.455278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.455281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.455286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.455292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.455297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.455301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.455306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.455311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.455316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.455321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.455326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.455331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.455336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.455340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.455345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.455386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:13.466897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:13.467931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:13.467938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:13.467940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:13.467944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:13.467951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2712 [2:7556256967666854491:10391]
2025-10-01T14:16:13.467970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:13.467986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:13.467990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:13.467994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:13.467996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:13.468014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:13.468019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:13.468025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:13.468100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.468102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.468104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.468107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:13.468110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:13.468179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:13.468181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.468192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.468201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.468214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:13.468230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.468233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.468235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.468243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:13.468248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:13.468250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:13.468251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:13.468256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:13.468267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:13.468270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:13.468280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776811:7396], now have 1 active actors on pipe
2025-10-01T14:16:13.468283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776911:7209], now have 1 active actors on pipe
2025-10-01T14:16:13.468286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776601:2446], now have 1 active actors on pipe
2025-10-01T14:16:13.468323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.468332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:13.468571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2712
2025-10-01T14:16:13.468599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2712, pipe: [1:7556256970043776911:7209]
2025-10-01T14:16:13.468626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2712
2025-10-01T14:16:13.468659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:13.468915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.468925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.468956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:13.468964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:13.468969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:13.468972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:13.468981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:13.468992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:13.469010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:13.469285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.469292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.469306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:13.469439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2713 partition: 0 MaxSeqNo: 45 sessionId: src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0
2025-10-01T14:16:13.469876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964788f8-1eb564b1-5c672da8-e01558bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:13.472702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Write session: try to update token
2025-10-01T14:16:13.472721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:13.505688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId: src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:13.509111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:13.508609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:13.508630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:13.508634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:13.508637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:13.508647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.508653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.508660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256967666854485:10391]
2025-10-01T14:16:13.508714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:13.508722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.508725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:13.508912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:13.509205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:13.509210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:13.509214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:13.700927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:13.701390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.701404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.701965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:13.704315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:13.704329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:13.704378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2713 reason: error at write: Disconnected sessionId: src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0
2025-10-01T14:16:13.704557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2713 sessionId: src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0 is DEAD
2025-10-01T14:16:13.704691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256970043776911:7209]
2025-10-01T14:16:13.704704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:13.706534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:13.706541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Write session will restart in 0.009156s
2025-10-01T14:16:13.706564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Write session: Do CDS request
2025-10-01T14:16:13.706574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:13.719269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.719655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:13.719671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2714
2025-10-01T14:16:13.720107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.720147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:13.720153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:13.720157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:13.720719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2714 sessionId:  describe result for acl check
2025-10-01T14:16:13.720757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:13.720762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:13.720764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:13.720769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256970043776952:7430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:13.721261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256970043776952:7430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:13.731392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256970043776952:7430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:13.746655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256970043776952:7430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:13.746674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256970043776952:7430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:13.746677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256970043776952:7430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:13.746686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:13.774023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:13.774802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:13.774995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:13.775008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:13.775018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:13.775068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:13.775103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256967666854793:10389]
2025-10-01T14:16:13.775644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:13.776073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:13.776123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:13.776423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:13.776480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.776481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.776482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.776483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.776485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.776486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.776487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.776488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.776490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.776491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.776492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.776493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.776495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.776496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.776516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.776526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.776530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.776534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.776538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.776543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.776547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.776550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.776553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.776558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.776562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.776565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.776569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.776573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.776580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.776588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:13.776594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.776599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:13.776604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.776609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:13.776615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.776620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:13.776625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.776631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:13.776635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.776639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:13.776644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.776649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:13.776654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.776658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:13.776663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.776670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:13.776675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.776680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.776686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.776691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.776695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.776699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.776703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.776707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:13.776714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.776719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:13.776773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:13.782022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:13.783228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:13.783235Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:13.783237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:13.783241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:13.783248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2713 [2:7556256967666854793:10389]
2025-10-01T14:16:13.783261Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:13.783277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:13.783281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:13.783284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:13.783286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:13.783302Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:13.783308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:13.783313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:13.783376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.783378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.783380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.783383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:13.783386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:13.783466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:13.783469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.783483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:13.783492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:13.783506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:13.783522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.783525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.783526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.783539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:13.783555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:13.783568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:13.783571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:13.783608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.783611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:13.785364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2713
2025-10-01T14:16:13.785392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2713
2025-10-01T14:16:13.784729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:13.784737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:13.784740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:13.784745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:13.792884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043777074:7430], now have 1 active actors on pipe
2025-10-01T14:16:13.792902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043776935:2446], now have 1 active actors on pipe
2025-10-01T14:16:13.792924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.792931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.792967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:13.792978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:13.792983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:13.792986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:13.792997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:13.793013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:13.793033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:13.794063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.794074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.794093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:13.794608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2714 partition: 0 MaxSeqNo: 45 sessionId: src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0
2025-10-01T14:16:13.795094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c7dd13-514c0d3d-f89b7d6d-f048d88b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:13.797653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Write session: try to update token
2025-10-01T14:16:13.797669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:13.805717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043777262:7209], now have 1 active actors on pipe
2025-10-01T14:16:13.805266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256970043777262:7209]
2025-10-01T14:16:13.805877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2713, pipe: [1:7556256970043777262:7209]
2025-10-01T14:16:13.812141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:13.812160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:13.812164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:13.812165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:13.812177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.812181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.812185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256967666854788:10389]
2025-10-01T14:16:13.812231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:13.812239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:13.812241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:13.812383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:13.814505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:13.814517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:13.814521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:13.830754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId: src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:13.833283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:13.970365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:13.970913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:13.970923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:13.974699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:13.975376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:13.975420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:13.975488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2714 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0
2025-10-01T14:16:13.975663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2714 sessionId: src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0 is DEAD
2025-10-01T14:16:13.975693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256970043777262:7209]
2025-10-01T14:16:13.976114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:16:13.976122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Write session will restart in 0.008677s
2025-10-01T14:16:13.976148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Write session: Do CDS request
2025-10-01T14:16:13.976154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:13.987050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.987436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:13.987451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2715
2025-10-01T14:16:13.987602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:13.987629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:13.987645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:13.987648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:13.988041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2715 sessionId:  describe result for acl check
2025-10-01T14:16:13.988069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:13.988071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:13.988072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:13.988076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256970043777281:7438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:13.988608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256970043777281:7438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:13.997836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256970043777281:7438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:14.032286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256970043777281:7438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:14.032306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256970043777281:7438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:14.032310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256970043777281:7438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:14.032319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:14.054402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:14.057866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:14.058099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:14.058104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:14.058116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:14.058161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:14.058196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256971961822411:10382]
2025-10-01T14:16:14.058784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:14.059305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:14.059352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:14.059698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:14.059790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.059792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.059793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.059794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.059795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.059797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.059798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.059800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.059801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.059806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.059808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.059809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.059810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.059811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.059819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.059829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.059832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.059836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.059838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.059842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.059845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.059849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.059852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.059856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.059859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.059863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.059867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.059870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.059879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.059886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.059892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.059897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.059902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.059907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.059911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.059916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.059922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.059927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.059933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.059938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.059945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.059951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.059955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.059960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.059964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.059969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.059973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.059978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.059987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.059991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.059996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.060000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.060005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.060009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.060013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.060018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.060055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:14.064780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:14.065601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:14.065606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:14.065609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:14.065612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:14.065620Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2714 [2:7556256971961822411:10382]
2025-10-01T14:16:14.065638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:14.065658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:14.065661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:14.065664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:14.065667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:14.065683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:14.065688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:14.065694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:14.065757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.065759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.065762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.065765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:14.065767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:14.065844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:14.065847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.065861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.065875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.065891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:14.065908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.065911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.065913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.065925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:14.065940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:14.065954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:14.065958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:14.065993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.065995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:14.070508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:14.070526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:14.070530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:14.070537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:14.071019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256970043777270:2446], now have 1 active actors on pipe
2025-10-01T14:16:14.071025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338744737:7438], now have 1 active actors on pipe
2025-10-01T14:16:14.078384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256974338744866:7209]
2025-10-01T14:16:14.079256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2714
2025-10-01T14:16:14.079291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2714
2025-10-01T14:16:14.082280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2714, pipe: [1:7556256974338744866:7209]
2025-10-01T14:16:14.082633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.082656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.082676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338744866:7209], now have 1 active actors on pipe
2025-10-01T14:16:14.082695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|178400a8-154acd8f-e3d74f1e-260ca700_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:14.082705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:14.082710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:14.082714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:14.082725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:14.082741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:14.082761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:14.085872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2715 partition: 0 MaxSeqNo: 45 sessionId: src_id|178400a8-154acd8f-e3d74f1e-260ca700_0
2025-10-01T14:16:14.086802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a59c92-5997b7c2-9a173b3c-85c603d9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|178400a8-154acd8f-e3d74f1e-260ca700_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:14.089228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Write session: try to update token
2025-10-01T14:16:14.089245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:14.085077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.085092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.085124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:14.108784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:14.108808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:14.108811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:14.108813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:14.108822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.108826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.108830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256971961822405:10382]
2025-10-01T14:16:14.108881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:14.108890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.108892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:14.109039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:14.110479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:14.110486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:14.110490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:14.116561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId: src_id|178400a8-154acd8f-e3d74f1e-260ca700_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:14.119454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:14.299859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256974338744866:7209]
2025-10-01T14:16:14.299882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:14.299913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:14.299915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:14.299966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2715 reason: error at write: Disconnected sessionId: src_id|178400a8-154acd8f-e3d74f1e-260ca700_0
2025-10-01T14:16:14.300153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2715 sessionId: src_id|178400a8-154acd8f-e3d74f1e-260ca700_0 is DEAD
2025-10-01T14:16:14.300540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:14.300551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Write session will restart in 0.005949s
2025-10-01T14:16:14.300577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Write session: Do CDS request
2025-10-01T14:16:14.300583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:14.297840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:14.298571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.298582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.299242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:14.307830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:14.310424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:14.310441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2716
2025-10-01T14:16:14.310608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:14.310640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:14.310646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:14.310650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:14.311389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2716 sessionId:  describe result for acl check
2025-10-01T14:16:14.311428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:14.311429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:14.311431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:14.311439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256974338744905:7445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:14.311987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256974338744905:7445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:14.318349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256974338744905:7445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:14.332173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256974338744905:7445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:14.332193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256974338744905:7445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:14.332196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256974338744905:7445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:14.332205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:14.344179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:14.344370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:14.344711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:14.344716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:14.344730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:14.344783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:14.344819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256971961822744:10365]
2025-10-01T14:16:14.345344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:14.347156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:14.347211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:14.347460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:14.347497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.347497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.347498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.347499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.347500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.347501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.347502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.347503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.347503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.347504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.347505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.347506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.347506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.347507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.347511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.347517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.347533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.347537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.347540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.347544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.347548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.347551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.347555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.347560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.347564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.347566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.347568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.347570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.347577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.347582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.347586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.347589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.347592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.347595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.347597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.347600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.347604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.347607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.347610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.347613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.347616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.347619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.347622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.347625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.347628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.347631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.347635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.347638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.347640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.347643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.347646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.347649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.347651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.347654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.347656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.347659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.347688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:14.351464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:14.352526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:14.352529Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:14.352531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:14.352533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:14.352540Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2715 [2:7556256971961822744:10365]
2025-10-01T14:16:14.352552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:14.352564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:14.352566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:14.352569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:14.352570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:14.352583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:14.352586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:14.352590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:14.352630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.352631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.352633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.352635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:14.352637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:14.352705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:14.352707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.352718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.352728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.352740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:14.352760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.352762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.352764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.352772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:14.352782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:14.352784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:14.352785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:14.352787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:14.352798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:14.352800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:14.352809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338745133:7445], now have 1 active actors on pipe
2025-10-01T14:16:14.352812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338744881:2446], now have 1 active actors on pipe
2025-10-01T14:16:14.352837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.352845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:14.352854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:14.353295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2715
2025-10-01T14:16:14.353326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2715
2025-10-01T14:16:14.353631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.353641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.353670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:14.353678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:14.353683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:14.353685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:14.353695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:14.353705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:14.353722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:14.353985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.353990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.354002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:14.354536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178400a8-154acd8f-e3d74f1e-260ca700_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:14.354134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2716 partition: 0 MaxSeqNo: 45 sessionId: src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0
2025-10-01T14:16:14.357288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Write session: try to update token
2025-10-01T14:16:14.357305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:14.391162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId: src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:14.393967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:16:14.394397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.394420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.394457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:16:14.394939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:16:14.399026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256974338745199:7209]
2025-10-01T14:16:14.399361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2715, pipe: [1:7556256974338745199:7209]
2025-10-01T14:16:14.399323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338745199:7209], now have 1 active actors on pipe
2025-10-01T14:16:14.407516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:14.407534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:14.407536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:14.407538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:14.407553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.407558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.407562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256971961822738:10365]
2025-10-01T14:16:14.407607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:14.407614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:14.407620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:14.407621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.407624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:14.407625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:14.407835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:14.554286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:16:14.562605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.562630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.562804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.562879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.562947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.563017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.563062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.563072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.563150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.563217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.563281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.563350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.563397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.563404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.563473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.563532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.563632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.563734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.563856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.563864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.563933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.564031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.564130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.564195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.564241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.564249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.564318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.564432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.564494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.564571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.564617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.564627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.564707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.564772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.564839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.564904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.564948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.564951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.565026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.565088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.565165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.565241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.565288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.565295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.565368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.565437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.565514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.565592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.565636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.565642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.565710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.565774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.565832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.565897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.565944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.565950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.566025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:16:14.566090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:16:14.566160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:16:14.566230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:16:14.566278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:16:14.566285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:16:14.567565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:16:14.567578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Write session will restart in 0.008014s
2025-10-01T14:16:14.567605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Write session: Do CDS request
2025-10-01T14:16:14.567612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:16:14.567173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256974338745199:7209]
2025-10-01T14:16:14.567209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:16:14.567212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:16:14.567238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2716 reason: error at write: Disconnected sessionId: src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0
2025-10-01T14:16:14.567437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2716 sessionId: src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0 is DEAD
2025-10-01T14:16:14.567858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:16:14.567609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:16:14.586661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:14.586904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:16:14.586921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2717
2025-10-01T14:16:14.587142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:16:14.587181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:16:14.587186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:16:14.587190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:16:14.587747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2717 sessionId:  describe result for acl check
2025-10-01T14:16:14.587788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:16:14.587790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:16:14.587795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:16:14.587801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256974338745220:7465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:16:14.588323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256974338745220:7465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:16:14.600289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256974338745220:7465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:16:14.609264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256974338745220:7465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:16:14.609283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256974338745220:7465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:16:14.609286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256974338745220:7465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:16:14.609296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:16:14.637124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:16:14.646188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:16:14.646650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:16:14.646656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:16:14.646684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:16:14.646762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:16:14.646802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256971961823051:10363]
2025-10-01T14:16:14.647407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:16:14.649620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:16:14.649677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:16:14.650049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:16:14.650098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.650099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.650101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.650102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.650104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.650105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.650107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.650108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.650110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.650111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.650112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.650114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.650115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.650116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.650122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.650132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.650137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.650141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.650146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.650150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.650154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.650158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.650162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.650169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.650172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.650176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.650180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.650184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.650193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.650201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:16:14.650207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.650213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:16:14.650218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.650224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:16:14.650229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.650234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:16:14.650239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.650244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:16:14.650249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.650254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:16:14.650259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.650265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:16:14.650270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.650276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:16:14.650281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.650286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:16:14.650292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.650297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.650301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.650307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.650311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.650316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.650320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.650325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:16:14.650329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.650334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:16:14.650393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:16:14.654767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:16:14.655806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:16:14.655812Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:16:14.655814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:16:14.655818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:16:14.655825Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2716 [2:7556256971961823051:10363]
2025-10-01T14:16:14.655843Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:16:14.655860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:16:14.655863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:14.655867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:14.655869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:14.655884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:16:14.655889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:16:14.655896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:16:14.655951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.655953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.655955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.655959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:16:14.655962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:16:14.656025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:16:14.656028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.656039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:16:14.656049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:16:14.656064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:16:14.656081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.656084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.656086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.656098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:16:14.656111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:16:14.656124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:16:14.656127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:16:14.656154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.656157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:16:14.658286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:16:14.658301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:16:14.658303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:16:14.658309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:16:14.658572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2716
2025-10-01T14:16:14.658659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2716
2025-10-01T14:16:14.661978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338745375:7465], now have 1 active actors on pipe
2025-10-01T14:16:14.661995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338745204:2446], now have 1 active actors on pipe
2025-10-01T14:16:14.662023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.662029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.662063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e870d255-cf067165-e3882e6-b4a26ae0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:16:14.662079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:16:14.662088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:16:14.662092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:16:14.662103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:16:14.662116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:16:14.662134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:14.664574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256974338745517:7209]
2025-10-01T14:16:14.665081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:16:14.665093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:16:14.665105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256974338745517:7209], now have 1 active actors on pipe
2025-10-01T14:16:14.665117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:16:14.665216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_17894272478703188343_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2716, pipe: [1:7556256974338745517:7209]
2025-10-01T14:16:14.665263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2717 partition: 0 MaxSeqNo: 45 sessionId: src_id|e870d255-cf067165-e3882e6-b4a26ae0_0
2025-10-01T14:16:14.665689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2314ca7-9d6a6fbd-2d6a6315-eed4468b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e870d255-cf067165-e3882e6-b4a26ae0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:16:14.668759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e870d255-cf067165-e3882e6-b4a26ae0_0] Write session: try to update token
2025-10-01T14:16:14.668780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e870d255-cf067165-e3882e6-b4a26ae0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:16:14.710039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:16:14.710062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:16:14.710064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:16:14.710067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:16:14.710076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.710081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.710085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256971961823045:10363]
2025-10-01T14:16:14.710134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:16:14.710145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:16:14.710148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:16:14.710300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:16:14.714708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:16:14.714730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:16:14.714734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:16:14.722430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId: src_id|e870d255-cf067165-e3882e6-b4a26ae0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:16:14.724819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest

Traceback (most recent call last):
  File "library/python/testing/yatest_common/yatest/common/process.py", line 384, in wait
    wait_for(
  File "library/python/testing/yatest_common/yatest/common/process.py", line 765, in wait_for
    raise TimeoutError(truncate(message, MAX_MESSAGE_LEN))
yatest.common.process.TimeoutError: 600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9824364966/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/hgvb/004789/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "devtools/ya/test/programs/test_tool/run_test/run_test.py", line 1770, in main
    res.wait(check_exit_code=False, timeout=current_run_test_timeout, on_timeout=timeout_callback)
  File "library/python/testing/yatest_common/yatest/common/process.py", line 398, in wait
    raise ExecutionTimeoutError(self, str(e))
yatest.common.process.ExecutionTimeoutError: (("600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9824364966/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/hgvb/004789/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout",), {})
2025-10-01T14:06:13.922200Z :RetryDiscoveryWithCancel INFO: Random seed for debugging is 1759327573922191
2025-10-01T14:06:14.052497Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254393318842248:2081];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:14.052529Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:14.059857Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:14.060650Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556254393880388527:2163];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:14.060694Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/tmpl4AMp8/pdisk_1.dat
2025-10-01T14:06:14.062504Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:14.096470Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.102573Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.119464Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 11876, node 1
2025-10-01T14:06:14.128674Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/yandexDSzBGr.tmp
2025-10-01T14:06:14.128687Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/yandexDSzBGr.tmp
2025-10-01T14:06:14.128749Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/yandexDSzBGr.tmp
2025-10-01T14:06:14.128816Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:14.131871Z INFO: TTestServer started on Port 6910 GrpcPort 11876
TClient is connected to server localhost:6910
PQClient connected to localhost:11876
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:14.157870Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.157914Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:14.163191Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:14.164079Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-01T14:06:14.165458Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.165495Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:14.172097Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:14.172409Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:14.274430Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:14.359392Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:14.500440Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254393318843173:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.500478Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254393318843149:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.500558Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.501282Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254393318843178:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.501302Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.501439Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:14.509831Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254393318843176:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:14.559248Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254393880388749:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:14.559371Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NGE0YzU5OWItOTAwN2U4ZDUtZWI3NGFiMGItMWU3YmY3OTA=, ActorId: [2:7556254393880388709:2295], ActorState: ExecuteState, TraceId: 01k6g1gpf7028x5j8v08d9x0ts, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:14.559982Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:14.559995Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:14.588572Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254393318843357:2729] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.589845Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:14.593861Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254393318843374:2341], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:14.593953Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NTAyZmQxOC0zYjEwMDI3OC01YTk0NTIxMS1iOWViNDcyOA==, ActorId: [1:7556254393318843143:2322], ActorState: ExecuteState, TraceId: 01k6g1gpf18mx3s5gphb8c4jqn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:14.594114Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:14.624595Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11876", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:14.665800Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gpkq472bhdjnvvn7w5p6, Database: , SessionId: ydb://session/3?node_id=1&id=NmNhMjIwN2YtNmVjNTY0ZDItNmRkY2MzMjQtOWM1NDFkMmM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254393318843648:2938] 
2025-10-01T14:06:15.055207Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:15.062388Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:19.052970Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254393318842248:2081];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:19.053006Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:19.060562Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556254393880388527:2163];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:19.060599Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:19.803808Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11876
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:19.830596Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11876
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:19.841084Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254414793680652:3251] connected; active server actors: 1
2025-10-01T14:06:19.841233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:19.841361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:19.841682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:19.849398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:19.848520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:19.849117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:19.849159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:19.849166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:19.849178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:19.849304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254414793680651:3250], now have 1 active actors on pipe
2025-10-01T14:06:19.849311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254414793680670:2454], now have 1 active actors on pipe
2025-10-01T14:06:19.849475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:19.850395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:19.852620Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1gvny3jn9ez2h6m43gdxy, Database: , SessionId: ydb://session/3?node_id=1&id=ZmU0NGY1NzctYmQ5OTc5Mi1kY2JkNzczMC1kMTAxNjY1MA==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-01T14:06:19.864228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254414793680736:3306], now have 1 active actors on pipe
2025-10-01T14:06:19.864337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:19.865720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:19.865940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:19.865958Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:19.866018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:19.866114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254415355225801:2396]
2025-10-01T14:06:19.866793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:19.866798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:19.866803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254415355225801:2396]
2025-10-01T14:06:19.866810Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:19.867110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:19.867115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:19.867143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.867145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:19.867150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:19.867152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.867154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.867156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:19.867163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:19.867300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:19.867330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:19.868379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:19.868411Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327579912, TxId 281474976720679
2025-10-01T14:06:19.868419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.868421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.868442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:19.868481Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:19.869168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:19.869237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:19.869244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:19.869246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.869248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:19.869253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:19.869355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:19.869371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:19.869410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:19.870603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:19.870626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:19.871120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:19.967316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:19.967333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:19.967336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.067662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.067682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.067686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.170440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.170458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.170461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.270447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.270464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.270468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327579912
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327579912
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11876
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.360425Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-01T14:06:20.371242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.371264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.371270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.471627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.471651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.471655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.572007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.572023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.572026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.672353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.672366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.672368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.772702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.772718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.772722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11876
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.862338Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:20.874327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.874349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.874352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.875391Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:20.875628Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:20.875634Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11876
2025-10-01T14:06:20.880239Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:20.880680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:20.880692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:20.882607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:20.882667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:57598
2025-10-01T14:06:20.882680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57598 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:20.882686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:20.883132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:20.883176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:20.883184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:20.883186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:20.883192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:20.883756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:20.912629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:20.912767Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254419088648207:2487] connected; active server actors: 1
2025-10-01T14:06:20.912796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:20.912804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:20.917555Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254419088648207:2487] disconnected; active server actors: 1
2025-10-01T14:06:20.917568Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254419088648207:2487] disconnected no session
2025-10-01T14:06:20.931879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:20.931892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:20.931895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254419088648175:2487] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:20.931904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:20.932284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:20.932401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254419088648229:2487], now have 1 active actors on pipe
2025-10-01T14:06:20.932450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:20.932459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:20.932490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|13e7f4e7-10789eec-f19efee6-efaee4ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:20.932502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.932508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.932512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.932525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.932542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:20.932564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:20.932807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:20.932811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:20.932827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:20.932946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|13e7f4e7-10789eec-f19efee6-efaee4ea_0
2025-10-01T14:06:20.933264Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327580933 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:20.933305Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|13e7f4e7-10789eec-f19efee6-efaee4ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:20.933406Z :INFO: [] MessageGroupId [src] SessionId [src|13e7f4e7-10789eec-f19efee6-efaee4ea_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:20.933415Z :INFO: [] MessageGroupId [src] SessionId [src|13e7f4e7-10789eec-f19efee6-efaee4ea_0] Write session will now close
2025-10-01T14:06:20.933420Z :DEBUG: [] MessageGroupId [src] SessionId [src|13e7f4e7-10789eec-f19efee6-efaee4ea_0] Write session: aborting
2025-10-01T14:06:20.933571Z :INFO: [] MessageGroupId [src] SessionId [src|13e7f4e7-10789eec-f19efee6-efaee4ea_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:20.933577Z :DEBUG: [] MessageGroupId [src] SessionId [src|13e7f4e7-10789eec-f19efee6-efaee4ea_0] Write session: destroy
2025-10-01T14:06:20.933688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|13e7f4e7-10789eec-f19efee6-efaee4ea_0 grpc read done: success: 0 data: 
2025-10-01T14:06:20.933695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|13e7f4e7-10789eec-f19efee6-efaee4ea_0 grpc read failed
2025-10-01T14:06:20.933701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|13e7f4e7-10789eec-f19efee6-efaee4ea_0 grpc closed
2025-10-01T14:06:20.933705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|13e7f4e7-10789eec-f19efee6-efaee4ea_0 is DEAD
2025-10-01T14:06:20.933879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:20.934396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254419088648229:2487] destroyed
2025-10-01T14:06:20.934421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:20.934430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.934433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.934436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.976930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.976949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.976952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-01T14:06:21.002481Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:21570 } ]
2025-10-01T14:06:21.078483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.078500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.078504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.182448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.182466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.182469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.286018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.286038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.286041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.386082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.386106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.386110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.486487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.486505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.486508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.586792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.586812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.586815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.687135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.687151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.687155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.792041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.792057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.792061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.894465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.894480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.894482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.000602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.000621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.000625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.106182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.106199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.106203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.206257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.206271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.206274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.306699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.306712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.306714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.407015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.407029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.407033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.507554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.507567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.507571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.607937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.607954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.607958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.708046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.708060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.708063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.808434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.808450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.808453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.909833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.909852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.909855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.010223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.010251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.010254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.110479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.110499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.110502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.210929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.210950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.210953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.311210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.311229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.311232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.411619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.411635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.411639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.512227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.512240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.512242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.612761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.612775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.612778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.713124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.713141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.713144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.815114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.815135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.815138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.915412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.915432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.915435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.015729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.015747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.015750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.116049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.116069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.116072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.216492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.216512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.216515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.316818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.316834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.316837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.417155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.417179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.417181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.517550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.517572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.517574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.618513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.618528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.618530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.718715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.718733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.718736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.819067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.819084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.819087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.867242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:24.919779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.919801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.919804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.020265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.020283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.020285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.120599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.120620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.120623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.221028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.221051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.221053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.321364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.321383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.321386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.421726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.421743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.421746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.522068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.522082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.522085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.622443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.622465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.622469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.722732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.722753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.722756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.823253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.823274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.823277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.926440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.926463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.926466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:26.005446513  108810 chttp2_transport.cc:1143]             ipv4:127.0.0.1:21570: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:26.026359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.026397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.026400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.126686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.126703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.126705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.227031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.227048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.227052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.327386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.327402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.327404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.427742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.427760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.427764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.529171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.529189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.529193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.629464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.629482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.629486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.729824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.729838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.729842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.830191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.830211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.830215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.930543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.930564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.930567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.030842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.030860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.030863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.131234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.131253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.131255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.231588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.231610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.231613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.331950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.331966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.331970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.432299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.432317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.432321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.532855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.532880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.532884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.632987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.633003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.633006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.733341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.733363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.733366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.833740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.833760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.833764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.934027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.934046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.934050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.034428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.034448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.034451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.134717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.134735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.134739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.235123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.235141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.235144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.335460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.335475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.335479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.435813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.435837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.435840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.536162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.536178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.536182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.636497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.636519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.636522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.736864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.736884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.736887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.837215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.837230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.837233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.938867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.938884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.938888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:06:29.046434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.046453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.046456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.091232Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-01T14:06:29.091245Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:29.147615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.147630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.147632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.247890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.247904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.247907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.348163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.348176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.348179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.448560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.448576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.448579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.548901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.548916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.548919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.649253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.649268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.649270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.749584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.749597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.749600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.849940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.849959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.849962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.867877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:29.950315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.950330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.950334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.050678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.050700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.050703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.151000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.151017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.151019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.251350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.251366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.251368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.351729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.351750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.351753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.452077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.452094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.452097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.552424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.552442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.552445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.652770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.652789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.652792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.753155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.753173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.753177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.853489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.853509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.853513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.953830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.953859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.953862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.054188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.054205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.054208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.154547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.154569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.154571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.254894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.254911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.254915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.355230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.355247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.355250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.455604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.455628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.455632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.555954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.555974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.555976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.656293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.656313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.656316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.758498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.758514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.758517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.859814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.859839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.859843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.959893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.959906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.959909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.060500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.060515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.060518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.160625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.160642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.160646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.260958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.260971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.260973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.361303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.361318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.361321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.461688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.461708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.461711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.562269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.562290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.562293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.662389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.662409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.662412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:32.709490903  108826 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:21570: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:32.766443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.766464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.766467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.867311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.867331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.867334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.969464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.969490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.969493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.069939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.069960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.069963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.171291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.171310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.171313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.271635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.271650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.271653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.371986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.372000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.372004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.472362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.472388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.472391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.572731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.572752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.572757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.673077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.673100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.673105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.773401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.773421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.773423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.873746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.873775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.873778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.974128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.974144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.974146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.074454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.074473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.074476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.174842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.174860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.174863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.276094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.276112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.276115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.377520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.377537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.377540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.477782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.477797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.477799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.577758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.577771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.577774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.678424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.678442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.678445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.778470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.778491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.778495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.868138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:34.879426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.879448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.879451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.979699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.979717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.979721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.080048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.080067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.080071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.182617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.182635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.182638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.286646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.286663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.286666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.386203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.386219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.386221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.490438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.490462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.490466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.589982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.589998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.590002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.690306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.690326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.690329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.790710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.790727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.790731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.891051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.891069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.891072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.991410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.991432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.991435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.094426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.094444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.094449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.195681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.195699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.195702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.296045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.296066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.296069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.397954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.397970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.397973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.498340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.498355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.498358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.598633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.598651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.598654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.698975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.698990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.698993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.799443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.799462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.799465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.899679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.899694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.899697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.000497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.000513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.000516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.101204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.101224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.101227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.202336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.202353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.202357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.304019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.304038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.304040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.403989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.404008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.404012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.504422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.504445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.504449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.604691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.604714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.604717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.705068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.705086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.705090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.805421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.805439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.805441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.905763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.905781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.905784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.006071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.006092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.006095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.109860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.109883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.109887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.215092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.215138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.215142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.314338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.314361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.314365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.415959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.415980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.415983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.516054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.516076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.516079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.616380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.616401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.616404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.718606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.718626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.718629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.819181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.819199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.819202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.919539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.919558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.919561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.019879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.019899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.019902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.120224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.120241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.120244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.220592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.220610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.220622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.325766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.325787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.325790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.425913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.425932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.425936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.526245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.526265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.526268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.626598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.626698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.626704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.728698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.728714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.728715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.828864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.828877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.828880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.868435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:39.929468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.929485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.929488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.030003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.030022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.030025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.130612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.130644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.130648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.230753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.230771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.230774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.331071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.331089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.331092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.431379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.431394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.431398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.531811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.531825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.531828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.632178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.632198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.632201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.732515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.732531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.732534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.832814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.832830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.832834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.933193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.933205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.933207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.033577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.033591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.033594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.133933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.133952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.133955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.241578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.241597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.241601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.341300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.341319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.341322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.442454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.442470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.442473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.542527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.542547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.542551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.642827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.642844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.642848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.743167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.743184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.743187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.843513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.843529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.843531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.943927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.943947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.943950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.044255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.044276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.044279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.144585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.144607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.144609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.244963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.244977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.244981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.345317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.345338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.345341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.445666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.445685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.445688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.546036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.546057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.546059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.646396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.646412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.646415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.746730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.746747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.746750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.847030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.847045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.847048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.947436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.947453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.947456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.047781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.047797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.047800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.148122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.148139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.148141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.248505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.248523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.248527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.348863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.348877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.348880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.453507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.453522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.453525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.553640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.553657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.553661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.658434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.658454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.658457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.758442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.758461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.758464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.858754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.858775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.858778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.959910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.959931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.959936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.060439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.060456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.060459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.160853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.160872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.160875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.261212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.261225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.261228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.361569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.361583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.361586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.461910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.461921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.461924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.562269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.562285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.562288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.662629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.662646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.662648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.763504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.763520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.763523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.863829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.863842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.863844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.868465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:44.964211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.964228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.964231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.064534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.064573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.064575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.164916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.164933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.164936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.265242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.265259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.265262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.365609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.365629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.365632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.465953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.465970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.465974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.566267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.566285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.566288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.667713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.667732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.667736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.768067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.768083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.768087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.868395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.868411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.868414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.968750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.968776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.968779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.069113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.069131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.069133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.171649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.171664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.171667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.271816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.271841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.271845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.372214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.372229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.372232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.474856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.474875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.474878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.577880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.577896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.577899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.677843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.677861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.677864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.778175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.778203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.778206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.878528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.878546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.878549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.978913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.978934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.978938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.079211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.079226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.079228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.182489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.182508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.182512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.283035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.283048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.283050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.383379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.383393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.383396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.483722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.483735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.483738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.584061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.584074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.584077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.684409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.684423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.684426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.784805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.784823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.784826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.885151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.885162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.885164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.985519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.985538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.985540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.085845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.085859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.085861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.186208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.186227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.186231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.286574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.286589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.286592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.386893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.386907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.386909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.487267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.487292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.487295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.587572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.587588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.587590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.687977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.687998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.688002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.788301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.788328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.788331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.888682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.888703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.888707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.989046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.989061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.989064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.089415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.089434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.089437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.191042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.191061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.191064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.291698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.291727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.291741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.391966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.391983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.391987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.492306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.492322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.492325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.592643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.592659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.592661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.693047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.693067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.693070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.793373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.793388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.793391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.841478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:06:49.841518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-01T14:06:49.841877Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:06:49.842167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:06:49.842308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:06:49.842447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-01T14:06:49.868682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:49.893731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.893749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.893752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.994045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.994061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.994064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.095117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.095135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.095139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.195289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.195303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.195305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.300609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.300631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.300634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.400621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.400636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.400638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.500998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.501012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.501018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.601338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.601356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.601359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.702678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.702694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.702697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.803549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.803564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.803567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.904448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.904463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.904466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.004946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.004962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.004966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.105139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.105158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.105162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.205447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.205459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.205461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.305821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.305836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.305839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.406212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.406236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.406240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.506544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.506563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.506566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.606888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.606903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.606907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.707238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.707254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.707257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.807576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.807588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.807591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.907942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.907957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.907961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.008303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.008320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.008325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.108661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.108693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.108696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.210279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.210296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.210300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.310353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.310382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.310384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.410711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.410729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.410731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.511497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.511515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.511519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.611903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.611923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.611926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.712304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.712326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.712328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.812666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.812688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.812692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.913109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.913130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.913133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.013366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.013381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.013384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.115402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.115419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.115423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.215626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.215642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.215645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.315929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.315946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.315949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.416305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.416325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.416328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.516658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.516684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.516689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.616968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.616995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.616999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.717362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.717391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.717395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.817691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.817706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.817710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.919932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.919948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.919952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.019966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.019982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.019985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.121154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.121169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.121173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.221657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.221669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.221671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.322435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.322453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.322456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.422420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.422437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.422441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.522701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.522719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.522731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.623098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.623117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.623121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.723423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.723445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.723447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.826441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.826469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.826473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.869140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:54.930553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.930573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.930578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.031133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.031151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.031155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.131458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.131487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.131491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.234224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.234245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.234248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.334279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.334299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.334303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.434608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.434624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.434626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.535761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.535778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.535781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.636278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.636295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.636298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.736657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.736676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.736679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.837020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.837037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.837040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.937408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.937428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.937431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.037745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.037762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.037767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.138846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.138867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.138870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.238965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.238984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.238988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.339282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.339299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.339302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.439677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.439697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.439701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.540065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.540080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.540083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.640384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.640399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.640402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.740719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.740734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.740738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.844693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.844709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.844712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.945100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.945118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.945122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.045362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.045383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.045387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.145708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.145725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.145729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.248529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.248553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.248557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.348486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.348499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.348503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.449010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.449029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.449044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.550116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.550135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.550138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.650553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.650572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.650575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.754442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.754477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.754481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.855151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.855170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.855173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.955233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.955252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.955256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.056454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.056477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.056480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.158564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.158584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.158587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.261986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.262009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.262012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.362242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.362259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.362263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.464286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.464304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.464307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.566860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.566877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.566880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.670566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.670582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.670585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.770934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.770951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.770955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.871433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.871456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.871459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.971536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.971553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.971557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-01T14:06:58.994750Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:21570 } ]
2025-10-01T14:06:59.074437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.074456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.074460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.174878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.174893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.174896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.275382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.275401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.275404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.382452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.382475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.382488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.481293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.481310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.481313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.581797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.581814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.581817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.684899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.684917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.684920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.785061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.785090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.785094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.873919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:59.886541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.886557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.886561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.988004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.988020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.988023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.090463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.090484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.090487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.192955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.192974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.192977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.294207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.294247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.294250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.394423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.394446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.394449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.497509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.497538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.497542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.601355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.601373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.601376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.702432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.702449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.702452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.806755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.806771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.806774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.907417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.907437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.907442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.010482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.010501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.010504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.110635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.110653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.110656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.211298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.211318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.211321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.311789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.311804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.311806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.419186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.419206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.419210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.517110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.517128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.517131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.617493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.617511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.617514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.718876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.718895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.718898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.819229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.819245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.819247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.919586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.919610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.919613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.019959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.019979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.019982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.120542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.120560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.120564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.221484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.221508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.221511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.322026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.322045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.322049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.422392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.422411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.422415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.526235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.526251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.526253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.626939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.626956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.626959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.727557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.727574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.727578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.827857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.827875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.827878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.928243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.928259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.928263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.031863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.031885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.031888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.133224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.133242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.133245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.233397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.233416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.233420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.336960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.336977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.336981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.437365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.437381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.437385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.537544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.537561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.537564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.638752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.638769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.638772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.741980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.742001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.742004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.842472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.842489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.842492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.942522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.942539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.942543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.042825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.042856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.042859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.143213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.143233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.143236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.244121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.244142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.244145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.344413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.344432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.344435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.445023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.445041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.445044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.545118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.545137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.545141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.645456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.645472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.645475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.745827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.745846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.745849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.846163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.846179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.846183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.873454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:04.948145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.948164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.948167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.050474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.050497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.050500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:07:05.153803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.153822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.153825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.254251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.254268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.254271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.358043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.358066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.358069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.457978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.457996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.457999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.564331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.564350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.564353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.664618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.664638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.664643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.770838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.770859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.770862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.873277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.873297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.873299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.974629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.974650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.974653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.078888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.078909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.078913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.181712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.181734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.181738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.282274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.282292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.282295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.382685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.382703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.382707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.486451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.486473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.486478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.586519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.586538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.586541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.696798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.696819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.696823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.797151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.797168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.797171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.897264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.897286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.897289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.997635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.997655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.997658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.100526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.100542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.100543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.201418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.201436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.201438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.302647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.302663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.302666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.403120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.403139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.403142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.503472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.503489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.503492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.603827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.603845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.603848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.706497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.706513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.706516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.810540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.810560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.810563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.910554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.910572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.910581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.010854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.010875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.010879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.111194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.111209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.111212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.211755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.211771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.211774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.312197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.312217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.312220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.414742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.414764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.414768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.514478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.514497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.514501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.616949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.616969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.616973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.719778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.719795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.719799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.823618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.823633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.823637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.929242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.929264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.929267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.029916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.029933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.029937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.130041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.130057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.130060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.230408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.230424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.230427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.330784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.330798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.330802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.432099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.432115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.432118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.533669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.533686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.533690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.640119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.640157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.640161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.740394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.740409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.740411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.840871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.840888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.840893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.873557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:09.942462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.942477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.942480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.047211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.047228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.047232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.147947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.147962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.147965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.248505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.248533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.248539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.350436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.350458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.350461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.454432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.454455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.454458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.555198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.555213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.555217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.655727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.655744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.655747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.758437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.758459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.758463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.861409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.861429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.861432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.961069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.961087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.961090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.063356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.063378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.063381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.163754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.163775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.163778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.264508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.264530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.264533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.364509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.364529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.364532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.466496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.466512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.466516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.566861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.566874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.566877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.670443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.670463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.670466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.770452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.770465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.770467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.870919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.870947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.870950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.973381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.973400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.973404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.074762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.074780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.074784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.174941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.174954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.174956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.275294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.275310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.275314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.378505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.378528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.378531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.482480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.482498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.482502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.583070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.583086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.583088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.691050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.691067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.691071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.794657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.794680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.794683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.895506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.895525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.895528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.001138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.001156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.001159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.098598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.098626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.098629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.200463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.200485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.200489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.306540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.306560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.306564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.406662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.406683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.406686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.510516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.510539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.510543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.612653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.612673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.612676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.715606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.715624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.715627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.818841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.818857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.818861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.918819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.918840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.918844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.022123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.022141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.022143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.121851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.121884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.121888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.226441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.226455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.226458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.329088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.329103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.329107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.434067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.434082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.434084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.534535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.534656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.534659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.631477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.631498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.631501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.738464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.738480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.738483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.841333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.841352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.841355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.874355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:14.941226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.941254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.941257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.042500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.042521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.042524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.143033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.143055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.143059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.246126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.246144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.246148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.346289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.346308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.346310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.447854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.447873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.447883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.548015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.548035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.548043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.650550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.650566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.650569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.754446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.754469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.754473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.858450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.858470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.858473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.962468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.962485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.962488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.066432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.066455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.066458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.167454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.167477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.167480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.267726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.267749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.267753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.369263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.369284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.369288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.472373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.472395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.472398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.574247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.574275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.574278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.678000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.678022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.678024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.780402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.780421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.780424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.882446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.882464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.882467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.992103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.992128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.992131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.094446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.094473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.094476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.194889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.194910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.194914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.294975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.294998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.295001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.396353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.396379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.396382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.500208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.500233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.500236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.599067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.599086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.599089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.702355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.702389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.702391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.802650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.802681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.802684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.910709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.910732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.910735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.011272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.011289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.011292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.113370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.113389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.113391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.214505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.214523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.214527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.316648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.316665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.316669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.416720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.416741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.416744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.518503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.518520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.518523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.618457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.618477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.618480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.718814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.718831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.718834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.819167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.819192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.819195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.921711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.921737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.921741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.030310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.030331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.030335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.131243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.131260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.131263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.234454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.234477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.234480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.334458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.334474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.334477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.435445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.435462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.435465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.535930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.535947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.535951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.638467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.638486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.638489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.739040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.739058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.739061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.839686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.839708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.839711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.843899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:07:19.843978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-01T14:07:19.844872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:07:19.844924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:07:19.844440Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:07:19.876333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:19.941475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.941501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.941504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.048980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.049001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.049005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.148983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.149003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.149007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.248267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.248292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.248296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.349671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.349693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.349696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.450567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.450585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.450589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.553063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.553086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.553090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.658556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.658583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.658586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.755621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.755636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.755639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.856666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.856682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.856685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.957534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.957558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.957561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.057643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.057659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.057662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.158522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.158541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.158544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.258920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.258939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.258943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.364648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.364670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.364673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.467114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.467133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.467137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.567068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.567089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.567092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.667435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.667459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.667461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.767824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.767845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.767848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.870509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.870537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.870541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.973781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.973801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.973804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.075246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.075266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.075270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.175507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.175526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.175529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.276031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.276053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.276056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.378143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.378163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.378166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.482470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.482491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.482495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.582642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.582661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.582664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.682586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.682603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.682605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.790452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.790477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.790481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.890100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.890121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.890124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.994454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.994474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.994477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.094913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.094934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.094938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.198642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.198661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.198664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.298662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.298680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.298684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.400201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.400221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.400226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.503626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.503645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.503649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.606610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.606628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.606631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.705811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.705832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.705835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.806566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.806585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.806589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.907041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.907062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.907065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.009741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.009771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.009774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.109869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.109891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.109893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.210910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.210929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.210933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.311121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.311139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.311143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.412184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.412203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.412206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.512566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.512585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.512588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.613460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.613479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.613481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.713832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.713852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.713856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.817727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.817746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.817749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.876802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:24.917159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.917187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.917190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.017501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.017519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.017520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.121069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.121087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.121090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.222576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.222594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.222598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.322940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.322958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.322960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.423274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.423293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.423296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.526780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.526805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.526809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.626637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.626662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.626665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.727173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.727194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.727198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.830605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.830625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.830629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.930471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.930492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.930494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.033402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.033422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.033425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.132105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.132123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.132127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.235799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.235821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.235824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.334867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.334883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.334886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.435297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.435319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.435322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.538540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.538566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.538570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.638746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.638772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.638775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.742546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.742566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.742569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.846969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.846987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.846991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.947622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.947640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.947643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.053218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.053241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.053244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.153143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.153158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.153161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.254175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.254191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.254194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.362436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.362456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.362459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.462620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.462641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.462644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.562575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.562596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.562599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.662787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.662805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.662809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.766491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.766511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.766514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.866720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.866743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.866747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.967104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.967124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.967127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.072160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.072183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.072186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.170937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.170957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.170959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.271223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.271242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.271246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.371550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.371566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.371569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.471910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.471927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.471931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.572276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.572300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.572303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.672606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.672636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.672639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.776555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.776578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.776581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.878196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.878216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.878220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.979728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.979745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.979748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.080261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.080287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.080290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.184248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.184270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.184273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.282943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.282964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.282967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.384019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.384037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.384040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.486563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.486582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.486586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.590767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.590785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.590788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.691057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.691076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.691080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.791409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.791427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.791430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.886514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:29.894520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.894540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.894544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.993978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.993994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.993996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.094654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.094673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.094676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.195434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.195453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.195456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.295640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.295655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.295657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.396151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.396172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.396175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.502891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.502911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.502914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.606512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.606530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.606533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.706924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.706945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.706949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.809496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.809515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.809519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.909640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.909661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.909664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.010504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.010524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.010527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.110687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.110704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.110707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.213973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.213996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.214000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.314194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.314213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.314216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.414430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.414448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.414451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.518542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.518562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.518566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.617211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.617230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.617234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.717462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.717479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.717482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.818652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.818673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.818676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.922508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.922528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.922531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.020491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.020510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.020513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.120895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.120915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.120919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.222196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.222216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.222220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.322999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.323018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.323021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.425150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.425168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.425171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.525927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.525946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.525950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.626351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.626408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.626412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.726713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.726732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.726735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.827073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.827091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.827094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.936962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.936981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.936985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.038640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.038660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.038664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.138829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.138851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.138854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.243694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.243714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.243718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.343711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.343729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.343733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.444036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.444055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.444057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.546630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.546646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.546649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.646716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.646735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.646738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.747041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.747067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.747071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.847547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.847562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.847564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.948456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.948475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.948479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.050450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.050473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.050477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.150545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.150566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.150570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.253620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.253642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.253646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.357934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.357956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.357960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.455425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.455446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.455449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.558475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.558496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.558499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.657922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.657937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.657940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.758363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.758394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.758398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.858631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.858648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.858651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.887022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:34.959259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.959284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.959288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.062539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.062560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.062564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-01T14:07:35.151271Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:21570 } ]
2025-10-01T14:07:35.163179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.163201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.163204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.263819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.263839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.263843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.364175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.364193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.364196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.464366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.464385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.464388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.564692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.564710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.564714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.665125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.665158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.665162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.766569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.766588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.766592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.869590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.869607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.869609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.970508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.970526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.970529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.074489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.074511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.074514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.174532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.174552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.174556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.278542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.278561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.278565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.380924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.380942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.380945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.510019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.510037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.510041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.615006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.615028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.615031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.714528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.714545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.714548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.817524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.817550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.817554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.920733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.920755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.920758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.024390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.024407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.024410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.130449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.130471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.130475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.226748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.226767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.226770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.327423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.327441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.327445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.429174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.429195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.429199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.531080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.531108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.531112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.634835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.634854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.634858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.735024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.735042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.735046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.837695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.837713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.837716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.942497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.942521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.942524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.046447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.046465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.046472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.150598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.150624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.150627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.250573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.250599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.250602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.354677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.354698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.354702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.458431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.458450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.458453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.562810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.562829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.562832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.662753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.662767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.662769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.766476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.766496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.766503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.866564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.866584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.866588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.967339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.967356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.967358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.067771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.067792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.067795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.168304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.168324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.168327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.268452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.268471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.268474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.373767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.373788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.373792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.474074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.474095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.474099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.573114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.573131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.573134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.682464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.682485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.682489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.779391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.779418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.779422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.879807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.879826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.879830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.887520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:39.986465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.986489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.986493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.084593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.084611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.084615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.190430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.190452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.190455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.290562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.290581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.290585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.390763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.390781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.390785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.494494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.494520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.494524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.594709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.594730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.594733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.694873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.694893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.694897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.798452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.798474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.798506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.898155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.898178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.898181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.002454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.002477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.002481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.101400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.101420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.101424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.201755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.201771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.201773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.302868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.302886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.302899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.406483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.406503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.406507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.506413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.506431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.506434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.606778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.606798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.606811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.707105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.707124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.707127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.813028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.813046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.813049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.913453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.913470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.913473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.013816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.013834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.013837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.114118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.114136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.114138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.214507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.214530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.214534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.316941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.316961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.316965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.417307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.417325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.417328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.517599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.517616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.517619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.618023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.618035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.618039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.718476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.718492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.718496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.821874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.821892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.821896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.926898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.926917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.926920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.028288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.028309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.028313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.129675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.129696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.129699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.229769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.229787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.229790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.330440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.330463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.330467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.434442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.434463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.434466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.538438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.538454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.538457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.640164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.640181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.640184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.740441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.740459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.740462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.840659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.840677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.840681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:07:43.941558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.941577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.941581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.042346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.042365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.042382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.130123Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720847, task: 1, CA Id [1:7556254779865905757:3293]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-01T14:07:44.169510Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720847, task: 1, CA Id [1:7556254779865905757:3293]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-01T14:07:44.493625Z :RecreateObserver INFO: Random seed for debugging is 1759327664493616
2025-10-01T14:07:44.662501Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556254783798223341:2078];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:07:44.662529Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:07:44.667002Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-01T14:07:44.667318Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:07:44.674844Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-01T14:07:44.675016Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:07:44.675118Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556254783121119666:2271];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:07:44.675189Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/tmpkdgNSL/pdisk_1.dat
2025-10-01T14:07:44.706719Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:07:44.716245Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:07:44.716276Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:07:44.727029Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:07:44.727239Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 7699, node 3
2025-10-01T14:07:44.734438Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:07:44.738667Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/yandexg3Kpk8.tmp
2025-10-01T14:07:44.738682Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/yandexg3Kpk8.tmp
2025-10-01T14:07:44.738743Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/00483a/r3tmp/yandexg3Kpk8.tmp
2025-10-01T14:07:44.738775Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:07:44.740156Z INFO: TTestServer started on Port 63219 GrpcPort 7699
2025-10-01T14:07:44.742469Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:63219
PQClient connected to localhost:7699
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:07:44.771590Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:07:44.771627Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:07:44.775124Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:07:44.775320Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:07:45.167044Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254787416087086:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.167170Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254787416087054:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.167229Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.167626Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254787416087092:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.167634Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.170977Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:07:45.173525Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254788093191535:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.173545Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254788093191548:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.173554Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.176148Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254788093191574:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.176169Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.182646Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254788093191614:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.182676Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.182786Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254788093191618:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.182797Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:07:45.183207Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556254788093191575:2607] txid# 281474976720661, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:07:45.191230Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:07:45.203885Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556254788093191573:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-01T14:07:45.204043Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556254787416087091:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-01T14:07:45.236305Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:07:45.263420Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556254788093191869:2824] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:07:45.269035Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556254788093191892:2349], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:07:45.269128Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=OWUxOGI5YTAtNGU4ODMxNDQtMzlhN2ZkYzctNDU5OGFkZDI=, ActorId: [3:7556254788093191528:2321], ActorState: ExecuteState, TraceId: 01k6g1kf0k9mv3z5b32kj5e7qg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:07:45.269353Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:07:45.287214Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:07:45.303948Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556254787416087184:2173] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:07:45.313002Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556254787416087198:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:07:45.313118Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=YWRjYTk5NmUtNjZjZmJlZC1lZmM1MzNkMi0zOTE2NGNlYw==, ActorId: [4:7556254787416087052:2295], ActorState: ExecuteState, TraceId: 01k6g1kf0b86rg8e3qkv6s211x, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:07:45.313273Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:7699", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:07:45.374629Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1kf677d9x93s6252y69ff, Database: , SessionId: ydb://session/3?node_id=3&id=ZWVjMjcyOTAtZDgzYWIxMDYtYjIyZDVmZTctNmQxZDIyOWU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254788093192116:2996] 
2025-10-01T14:07:45.663792Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:07:45.662839Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:07:49.666917Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556254783798223341:2078];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:07:49.667064Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:07:49.667148Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556254783121119666:2271];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:07:49.667173Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:07:50.613976Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:7699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:07:50.640464Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:7699
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:07:50.651073Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:50.652110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:50.652165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:07:50.652172Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:50.652184Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:07:50.654162Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254809568029175:3332], now have 1 active actors on pipe
2025-10-01T14:07:50.654415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:50.657870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:50.657743Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254809568029176:3333] connected; active server actors: 1
2025-10-01T14:07:50.657914Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:07:50.658326Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:07:50.658687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556254808890924048:2385], now have 1 active actors on pipe
2025-10-01T14:07:50.658684Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-01T14:07:50.660284Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:07:50.661995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254809568029242:3385], now have 1 active actors on pipe
2025-10-01T14:07:50.662126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:50.662243Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1kmbp5cgxp8h9vjcatw69, Database: , SessionId: ydb://session/3?node_id=3&id=YTc4YjA4NmUtNzJiMjRlNjctNDM1OGUxMWYtMWRlMjBjNDE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:07:50.664471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:50.664697Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:50.664716Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:07:50.664780Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:50.664841Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556254809568029264:2472]
2025-10-01T14:07:50.665546Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:50.665550Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:50.665556Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556254809568029264:2472]
2025-10-01T14:07:50.665564Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:07:50.665829Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:07:50.665836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.665853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.665856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:50.665860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:07:50.665862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.665864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.665867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:07:50.665873Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:50.665948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:50.665974Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:50.671003Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:50.671052Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327670709, TxId 281474976720679
2025-10-01T14:07:50.671058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.671061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.671094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.671134Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:50.672711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-01T14:07:50.673594Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-01T14:07:50.673668Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:50.673676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.673679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.673680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.673690Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:50.673812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:07:50.673831Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:50.673897Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:50.676108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:50.676140Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:50.676699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:50.766580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.766597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.766600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.867329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.867351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.867354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.967666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.967684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.967688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.068492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.068509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.068513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.168871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.168898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.168902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327670709
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327670709
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:7699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:07:51.180230Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-01T14:07:51.269409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.269425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.269429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.369873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.369892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.369896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.470461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.470477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.470479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.570918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.570938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.570941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.673701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.673721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.673725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:7699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:07:51.687822Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:07:51.694823Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:07:51.695079Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:07:51.695087Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:7699
2025-10-01T14:07:51.695519Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:07:51.695851Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:51.695869Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:07:51.696172Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:07:51.696201Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53178
2025-10-01T14:07:51.696206Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53178 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:51.696210Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:51.697083Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:07:51.697135Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:51.697136Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:51.697138Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:51.697142Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:51.697682Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:51.721731Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:07:51.722026Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254813862996797:2511] connected; active server actors: 1
2025-10-01T14:07:51.722238Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:07:51.722249Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:51.725709Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254813862996797:2511] disconnected; active server actors: 1
2025-10-01T14:07:51.725725Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254813862996797:2511] disconnected no session
2025-10-01T14:07:51.747302Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327671747 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:51.747361Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:51.746232Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:51.750427Z :INFO: [] MessageGroupId [src] SessionId [src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0] Write session: close. Timeout = 0 ms
2025-10-01T14:07:51.746250Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:07:51.746253Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254813862996765:2511] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:51.746262Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:51.746669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254813862996819:2511], now have 1 active actors on pipe
2025-10-01T14:07:51.750472Z :INFO: [] MessageGroupId [src] SessionId [src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0] Write session will now close
2025-10-01T14:07:51.746698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:07:51.750490Z :DEBUG: [] MessageGroupId [src] SessionId [src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0] Write session: aborting
2025-10-01T14:07:51.746708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.746715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.746744Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:07:51.746754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.746759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.746763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:51.746773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.746787Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:51.746803Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.746835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.746838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.746848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.746870Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0
2025-10-01T14:07:51.750655Z :INFO: [] MessageGroupId [src] SessionId [src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:07:51.750661Z :DEBUG: [] MessageGroupId [src] SessionId [src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0] Write session: destroy
2025-10-01T14:07:51.750840Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0 grpc read done: success: 0 data: 
2025-10-01T14:07:51.750852Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0 grpc read failed
2025-10-01T14:07:51.750861Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0 grpc closed
2025-10-01T14:07:51.750867Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|8c0b39ed-ab2b77ff-555cefe4-994f7083_0 is DEAD
2025-10-01T14:07:51.751131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:07:51.751168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254813862996819:2511] destroyed
2025-10-01T14:07:51.751184Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:07:51.751195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.751200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.751202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:07:51.774055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.774074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.774077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.874416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.874440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.874444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.975442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.975462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.975465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.075678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.075696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.075700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.177454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.177478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.177482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.277355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.277373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.277377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.377791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.377809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.377812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.478057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.478074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.478077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.578432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.578449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.578452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.678741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.678759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.678766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-01T14:07:52.758708Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:12601 } ]
2025-10-01T14:07:52.758737Z :ERROR: [/Root] [] [207cdf6c-9acc5c0-42b8f8cd-65748aae] Federated state update failed. FederationState: { Status: TRANSPORT_UNAVAILABLE SelfLocation: "" Issues: { [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:12601 } ] } }
>>> Got event: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: GRpc error: (14): mock 'unavailable' <main>: Error: Grpc error response on endpoint localhost:12601 " }
Session2 was created
2025-10-01T14:07:52.779119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.779139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.779142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.879459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.879476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.879479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.979840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.979858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.979861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.080166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.080184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.080187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.180544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.180564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.180567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.280887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.280909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.280912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.381227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.381244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.381247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.481551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.481563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.481566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.581923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.581939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.581942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.682280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.682295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.682299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:07:53.770577Z :INFO: [/Root] [] [53c586e6-6e9d2795-811d662d-8b907594] Open read subsessions to databases: { name: dc1, endpoint: localhost:7699, path: /Root }, { name: dc2, endpoint: localhost:7699, path: /Root }, { name: dc3, endpoint: localhost:7699, path: /Root }
2025-10-01T14:07:53.772915Z :INFO: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Starting read session
2025-10-01T14:07:53.772928Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Starting single session
2025-10-01T14:07:53.773158Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.773163Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.773169Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:07:53.773734Z :INFO: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Starting read session
2025-10-01T14:07:53.773740Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Starting single session
2025-10-01T14:07:53.773771Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.773774Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.773777Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:07:53.773896Z :INFO: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Starting read session
2025-10-01T14:07:53.773899Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Starting single session
2025-10-01T14:07:53.773915Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.773918Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.773920Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:07:53.774822Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] Successfully connected. Initializing session
2025-10-01T14:07:53.774830Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] Successfully connected. Initializing session
2025-10-01T14:07:53.774897Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] Successfully connected. Initializing session
2025-10-01T14:07:53.775665Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:53.775677Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-01T14:07:53.775718Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:53.775719Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-01T14:07:53.775730Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:53.775731Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-01T14:07:53.777943Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:53.777989Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:53.778032Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 read init: from# ipv6:[::1]:48476, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:53.778061Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 read init: from# ipv6:[::1]:48476, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:53.778120Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:53.778142Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 read init: from# ipv6:[::1]:48476, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:53.778152Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 auth for : user
2025-10-01T14:07:53.778184Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 auth for : user
2025-10-01T14:07:53.778199Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 auth for : user
2025-10-01T14:07:53.778359Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 Handle describe topics response
2025-10-01T14:07:53.778404Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 auth is DEAD
2025-10-01T14:07:53.778428Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 Handle describe topics response
2025-10-01T14:07:53.778428Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:53.778440Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 auth is DEAD
2025-10-01T14:07:53.778451Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 Handle describe topics response
2025-10-01T14:07:53.778461Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 auth is DEAD
2025-10-01T14:07:53.778471Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:53.778803Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:53.778837Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:53.778846Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:53.779020Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:53.779570Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_3_15835439199166058845_v1" ClientId: "user" PipeClient { RawX1: 7556254822452931594 RawX2: 4503612512274942 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:07:53.779591Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 gone release: partition# 0
2025-10-01T14:07:53.779598Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:53.779602Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:53.779606Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:53.779607Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:53.779916Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_3_2_3499017688716200535_v1" ClientId: "user" PipeClient { RawX1: 7556254822452931595 RawX2: 4503612512274941 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:07:53.779928Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:53.780001Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7556254822452931599:2566]
2025-10-01T14:07:53.780008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254822452931599:2566], now have 1 active actors on pipe
2025-10-01T14:07:53.780019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.780026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.780038Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_2_3499017688716200535_v1 on pipe: [3:7556254822452931599:2566]
2025-10-01T14:07:53.780058Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_2_3499017688716200535_v1:1 with generation 1
2025-10-01T14:07:53.780060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.780067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.780069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:53.780095Z node 3 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_2_3499017688716200535_v1
2025-10-01T14:07:53.780103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.780154Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:53.779032Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931593:2556] connected; active server actors: 1
2025-10-01T14:07:53.779051Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931594:2558] connected; active server actors: 1
2025-10-01T14:07:53.779146Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556254822452931594:2558] session shared/user_3_3_15835439199166058845_v1
2025-10-01T14:07:53.779157Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:07:53.779171Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:07:53.779178Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_15835439199166058845_v1" (Sender=[3:7556254822452931586:2558], Pipe=[3:7556254822452931594:2558], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:53.779183Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:53.779191Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556254822452931593:2556] session shared/user_3_1_3741572943559240662_v1
2025-10-01T14:07:53.779195Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_3741572943559240662_v1" (Sender=[3:7556254822452931584:2556], Pipe=[3:7556254822452931593:2556], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:53.779199Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931595:2557] connected; active server actors: 1
2025-10-01T14:07:53.779210Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:53.779219Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_15835439199166058845_v1" (Sender=[3:7556254822452931586:2558], Pipe=[3:7556254822452931594:2558], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:53.779249Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_15835439199166058845_v1" sender [3:7556254822452931586:2558] lock partition 0 for ReadingSession "shared/user_3_3_15835439199166058845_v1" (Sender=[3:7556254822452931586:2558], Pipe=[3:7556254822452931594:2558], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-01T14:07:53.779266Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-01T14:07:53.779270Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000057s
2025-10-01T14:07:53.779276Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556254822452931595:2557] session shared/user_3_2_3499017688716200535_v1
2025-10-01T14:07:53.779280Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_3499017688716200535_v1" (Sender=[3:7556254822452931585:2557], Pipe=[3:7556254822452931595:2557], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:53.779283Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:53.779287Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-01T14:07:53.779290Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-01T14:07:53.779298Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_15835439199166058845_v1" sender [3:7556254822452931586:2558]  release partitions [0]. Target status Free
2025-10-01T14:07:53.779303Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000014s
2025-10-01T14:07:53.779705Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [3:7556254822452931594:2558] session shared/user_3_3_15835439199166058845_v1 partition 0
2025-10-01T14:07:53.779713Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:53.779719Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:53.779725Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_3499017688716200535_v1" (Sender=[3:7556254822452931585:2557], Pipe=[3:7556254822452931595:2557], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:53.779732Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_3499017688716200535_v1" sender [3:7556254822452931585:2557] lock partition 0 for ReadingSession "shared/user_3_2_3499017688716200535_v1" (Sender=[3:7556254822452931585:2557], Pipe=[3:7556254822452931595:2557], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-01T14:07:53.779741Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-01T14:07:53.779744Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000023s
2025-10-01T14:07:53.780448Z :INFO: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] Got InitResponse. ReadSessionId: shared/user_3_1_3741572943559240662_v1
2025-10-01T14:07:53.780455Z :INFO: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] Got InitResponse. ReadSessionId: shared/user_3_3_15835439199166058845_v1
2025-10-01T14:07:53.780462Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.780463Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.780498Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:53.780503Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:53.780515Z :INFO: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] Got InitResponse. ReadSessionId: shared/user_3_2_3499017688716200535_v1
2025-10-01T14:07:53.780518Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:53.780531Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:53.780716Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:07:53.780717Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:07:53.780737Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 got read request: guid# 46fe1fdc-90a8d40a-3dac846d-f82930b4
2025-10-01T14:07:53.780747Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:07:53.780754Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 got read request: guid# 2fb1fa0-ee80dc5e-dcac3c4b-dedda6d6
2025-10-01T14:07:53.780764Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 got read request: guid# 2950c338-6d524146-7a63bc02-539608bb
2025-10-01T14:07:53.781157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:53.781190Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:53.781199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.781201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.781203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.781210Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:53.781222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:07:53.781267Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327673682 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:07:53.781281Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:07:53.781306Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 sending to client partition status
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:07:53.782052Z :INFO: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:53.782062Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:53.782071Z :INFO: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 9 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:53.782094Z :NOTICE: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-01T14:07:53.782101Z :DEBUG: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] [] Abort session to cluster
2025-10-01T14:07:53.782204Z :INFO: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:53.782210Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-01T14:07:53.782214Z :INFO: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:53.782221Z :NOTICE: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-01T14:07:53.782224Z :DEBUG: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] [] Abort session to cluster
2025-10-01T14:07:53.782266Z :INFO: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:53.782275Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:53.782280Z :INFO: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:53.782285Z :NOTICE: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-01T14:07:53.782288Z :DEBUG: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] [] Abort session to cluster
2025-10-01T14:07:53.782325Z :INFO: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:53.782327Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:53.782330Z :INFO: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:53.782335Z :NOTICE: [/Root] [/Root] [498a44be-adf9fd6f-dd8deae5-6b64b68f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:07:53.782355Z :INFO: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:53.782358Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-01T14:07:53.782361Z :INFO: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:53.782365Z :NOTICE: [/Root] [/Root] [12ef9d6f-a75b3a08-4d178f0b-65fac99b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:07:53.782390Z :INFO: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:53.782394Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:53.782396Z :INFO: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 9 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:53.782401Z :NOTICE: [/Root] [/Root] [2ed86961-4c299a99-43f48ded-891f84fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:07:53.783016Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931594:2558] disconnected; active server actors: 1
2025-10-01T14:07:53.783030Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931594:2558] client user disconnected session shared/user_3_3_15835439199166058845_v1
2025-10-01T14:07:53.783040Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:53.783047Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931595:2557] disconnected; active server actors: 1
2025-10-01T14:07:53.783050Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931595:2557] client user disconnected session shared/user_3_2_3499017688716200535_v1
2025-10-01T14:07:53.783065Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:53.782612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.783077Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_3741572943559240662_v1" (Sender=[3:7556254822452931584:2556], Pipe=[3:7556254822452931593:2556], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:53.782623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.782625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.782649Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:07:53.782652Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 grpc read failed
2025-10-01T14:07:53.782657Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 closed
2025-10-01T14:07:53.783092Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_3741572943559240662_v1" sender [3:7556254822452931584:2556] lock partition 0 for ReadingSession "shared/user_3_1_3741572943559240662_v1" (Sender=[3:7556254822452931584:2556], Pipe=[3:7556254822452931593:2556], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-01T14:07:53.783105Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:07:53.782664Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:07:53.783108Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-01T14:07:53.782668Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 grpc read failed
2025-10-01T14:07:53.782673Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 grpc closed
2025-10-01T14:07:53.782680Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_3499017688716200535_v1 is DEAD
2025-10-01T14:07:53.782780Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_15835439199166058845_v1 is DEAD
2025-10-01T14:07:53.782875Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:07:53.782877Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 grpc read failed
2025-10-01T14:07:53.782879Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 grpc closed
2025-10-01T14:07:53.782882Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_3741572943559240662_v1 is DEAD
2025-10-01T14:07:53.782983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_2_3499017688716200535_v1
2025-10-01T14:07:53.782990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254822452931599:2566] destroyed
2025-10-01T14:07:53.783004Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_2_3499017688716200535_v1
2025-10-01T14:07:53.783133Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931593:2556] disconnected; active server actors: 1
2025-10-01T14:07:53.783140Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254822452931593:2556] client user disconnected session shared/user_3_1_3741572943559240662_v1
2025-10-01T14:07:53.882972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.882988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.882990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.983342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.983359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.983363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.083680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.083697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.083700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:14.963685Z :WaitEventBlocksBeforeDiscovery INFO: Random seed for debugging is 1759327574963677
2025-10-01T14:06:15.067017Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254398357526507:2154];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.067102Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:15.074992Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.075448Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556254399166147605:2261];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.075507Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/tmpPDutbD/pdisk_1.dat
2025-10-01T14:06:15.081011Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.105060Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.105264Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.116514Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 23763, node 1
2025-10-01T14:06:15.135608Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/yandexnyGQyW.tmp
2025-10-01T14:06:15.135618Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/yandexnyGQyW.tmp
2025-10-01T14:06:15.135665Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/yandexnyGQyW.tmp
2025-10-01T14:06:15.135694Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:15.138146Z INFO: TTestServer started on Port 24362 GrpcPort 23763
TClient is connected to server localhost:24362
PQClient connected to localhost:23763
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:15.170184Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.170219Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.173393Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:15.174619Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-01T14:06:15.179085Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.179114Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
waiting...
2025-10-01T14:06:15.181519Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:15.181846Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
2025-10-01T14:06:15.333675Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.386824Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.523138Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399166147699:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.523143Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399166147713:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.523162Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.523293Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399166147730:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.523310Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.525765Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:15.529094Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556254399166147729:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710657 completed, doublechecking }
2025-10-01T14:06:15.585979Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.586220Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254398357527409:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.586817Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ZjlkOTU4MTktMWI2YzY5OGUtZjYzOGNiMGMtYjk4MjI0MjE=, ActorId: [1:7556254398357527383:2323], ActorState: ExecuteState, TraceId: 01k6g1gqfk3yh1esxjrc19fph0, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.587186Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.597503Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254399166147776:2146] txid# 281474976710658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.602273Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254399166147799:2307], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.602340Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZmU5NzI5NjktNzM5YzdhZDUtOTgxYmFhMGMtNzU1MTUwZDc=, ActorId: [2:7556254399166147697:2294], ActorState: ExecuteState, TraceId: 01k6g1gqf22en1he55bbgqsv3j, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.602469Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.618782Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.642513Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:23763", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:15.681382Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6g1gqkd0897k85h3evhh8a1, Database: , SessionId: ydb://session/3?node_id=1&id=MjIyMTc0ZGUtYzE1M2JjMmUtYTdiY2YwMzMtYWU2N2M4YTI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254398357527792:2928] 
2025-10-01T14:06:16.072276Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:16.073251Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:20.067373Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254398357526507:2154];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.067409Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:20.073504Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556254399166147605:2261];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.073536Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:20.808449Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:23763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.838758Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:23763
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.862864Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254419832364803:3244] connected; active server actors: 1
2025-10-01T14:06:20.862922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.863844Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6g1gwne55v2c0r9d462qxbb, Database: , SessionId: ydb://session/3?node_id=1&id=ZWRmM2Q4OTItYzAxZmNjYzctYjZiMTVjNTQtMjZlODkwMWE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:20.864239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.865201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.868034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.870890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.870956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.870966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.870982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.871157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254419832364830:2452], now have 1 active actors on pipe
2025-10-01T14:06:20.871160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254419832364802:3243], now have 1 active actors on pipe
2025-10-01T14:06:20.872127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:20.872444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.873919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-01T14:06:20.882156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254419832364876:3292], now have 1 active actors on pipe
2025-10-01T14:06:20.882233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.887039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.887232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.887248Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.887313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.887379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254420640984809:2400]
2025-10-01T14:06:20.889261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.889273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.889278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254420640984809:2400]
2025-10-01T14:06:20.889285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.889586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.889591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.889616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.889619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.889622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.889624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.889625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.889627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.889633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.889763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.889794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.891636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.891670Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580927, TxId 281474976720677
2025-10-01T14:06:20.891675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.891677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.891696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.891731Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.892391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.892444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.892449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.892451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.892452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.892457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.892540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.892556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.892592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.895785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.895816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.896578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.990525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.990542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.990545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.094834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.094853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.094856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.197485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.197499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.197502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.298196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.298209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.298212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327580927
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327580927
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:23763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.381603Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.398577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.398590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.398594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.498932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.498953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.498956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.599280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.599295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.599299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.699571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.699587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.699589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.800999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.801018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.801021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.883355Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.888767Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.889024Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.889032Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:23763
2025-10-01T14:06:21.891371Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.891590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.891605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.892197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.892237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:54618
2025-10-01T14:06:21.892241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54618 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.892245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.892715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.892756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.892758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.892760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.892764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.893300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.902509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.902523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.902525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.002522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:22.002888Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254428422299650:2479] connected; active server actors: 1
2025-10-01T14:06:22.002990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:22.002995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.006476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.006490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.006494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.011081Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254428422299650:2479] disconnected; active server actors: 1
2025-10-01T14:06:22.011097Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254428422299650:2479] disconnected no session
2025-10-01T14:06:22.041394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.041410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:22.041414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254424127332305:2479] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.041434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.042190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:22.042179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254428422299673:2479], now have 1 active actors on pipe
2025-10-01T14:06:22.042384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.042402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.042432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:22.042443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.042450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.042453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.042464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.042480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.042501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.042849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.042855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.042869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.042997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0
2025-10-01T14:06:22.043296Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327582043 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:22.043327Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:22.043424Z :INFO: [] MessageGroupId [src] SessionId [src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:22.043429Z :INFO: [] MessageGroupId [src] SessionId [src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0] Write session will now close
2025-10-01T14:06:22.043433Z :DEBUG: [] MessageGroupId [src] SessionId [src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0] Write session: aborting
2025-10-01T14:06:22.043506Z :INFO: [] MessageGroupId [src] SessionId [src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:22.043510Z :DEBUG: [] MessageGroupId [src] SessionId [src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0] Write session: destroy
2025-10-01T14:06:22.043836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0 grpc read done: success: 0 data: 
2025-10-01T14:06:22.043841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0 grpc read failed
2025-10-01T14:06:22.043847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0 grpc closed
2025-10-01T14:06:22.043852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d4c1d45e-736f9575-1a38142e-8c6c03d9_0 is DEAD
2025-10-01T14:06:22.044075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:22.044307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254428422299673:2479] destroyed
2025-10-01T14:06:22.044324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:22.044331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.044335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.044337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Before ReadSession was created
Session was created
Returned from WaitEvent
2025-10-01T14:06:22.107250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.107264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.107266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.207130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.207146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.207149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.307397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.307415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.307418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.407728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.407744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.407746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.508628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.508646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.508649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.608928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.608952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.608955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.710692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.710704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.710707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.813247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.813260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.813263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.913606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.913628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.913630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.015468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.015480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.015482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session blocked successfully
Session closed gracefully
2025-10-01T14:06:23.115839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.115854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.115857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.216210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.216223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.216226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.316541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.316564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.316568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.418523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.418539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.418543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.518798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.518813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.518816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.620867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.620881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.620884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.720981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.720999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.721002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.821376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.821402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.821404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.921838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.921851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.921854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.022057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.022072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.022075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.122641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.122656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.122659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.223104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.223125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.223128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.323635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.323652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.323655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.423957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.423976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.423980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.524335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.524351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.524354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.624692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.624708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.624711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.725033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.725049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.725052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.825434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.825449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.825452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.925775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.925792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.925794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.026101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.026121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.026124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.126461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.126490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.126493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.227314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.227332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.227335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.329342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.329358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.329361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.429557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.429571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.429574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.531145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.531161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.531164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.631389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.631410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.631413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.731624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.731639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.731642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.831930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.831947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.831950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.889891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:25.932351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.932368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.932371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.034519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.034541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.034544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.135081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.135095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.135097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.235459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.235475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.235479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.335802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.335827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.335831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.437199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.437214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.437216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.537514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.537529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.537531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.638199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.638215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.638218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.738762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.738778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.738781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.840545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.840566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.840570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.940981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.940995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.940998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.041422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.041444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.041448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.142435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.142452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.142454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.242543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.242558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.242560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.343364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.343382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.343386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.444027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.444051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.444054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.544111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.544125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.544127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.646025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.646042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.646045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.746359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.746386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.746389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.846689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.846708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.846712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.947071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.947091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.947094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.047383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.047407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.047410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.149052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.149067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.149070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.249641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.249661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.249664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.350013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.350027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.350029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.450348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.450363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.450366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.550718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.550736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.550740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.651079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.651100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.651104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.751433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.751452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.751454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.851742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.851757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.851759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.952189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.952205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.952208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.054485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.054501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.054513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.155938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.155955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.155958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.256246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.256270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.256272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.356648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.356682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.356690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.456963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.456978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.456981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.557290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.557310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.557313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.657882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.657897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.657900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.758020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.758037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.758040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.858435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.858453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.858456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.958725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.958749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.958752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.059061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.059079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.059082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.096909Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-01T14:06:30.096927Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:30.159403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.159416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.159418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.259754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.259767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.259770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.360105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.360118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.360121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.460478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.460496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.460500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.560828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.560842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.560856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.661180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.661194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.661197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.761552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.761571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.761574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.861881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.861897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.861900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.890124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:30.962227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.962254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.962257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.062599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.062617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.062621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.162935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.162954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.162957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.263277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.263290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.263292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.363649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.363667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.363671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.463970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.463983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.463986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.564325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.564348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.564351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.665510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.665526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.665528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.765561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.765579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.765583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.866337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.866364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.866382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.966842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.966856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.966859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.067146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.067164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.067168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.167471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.167486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.167488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.267832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.267848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.267851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.368178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.368195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.368198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.468498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.468510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.468514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.568927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.568945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.568948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.669239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.669257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.669260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.769600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.769618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.769621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.870520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.870538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.870542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.970800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.970816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.970819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.071175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.071191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.071195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.172384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.172402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.172405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.273878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.273893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.273897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.374427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.374444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.374447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.474594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.474621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.474625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.575010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.575028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.575032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.678440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.678459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.678462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.778743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.778759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.778763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.879059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.879076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.879079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.979456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.979475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.979479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.079801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.079817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.079820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.180157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.180173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.180177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.282441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.282465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.282469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.386443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.386458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.386461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.489961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.489977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.489980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.590691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.590739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.590742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.691147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.691162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.691165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.793011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.793032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.793035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.893339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.893365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.893369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.994659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.994675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.994678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.095092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.095106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.095110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.195470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.195488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.195491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.295878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.295897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.295899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.396128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.396148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.396153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.498483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.498504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.498507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.602424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.602441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.602443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.701296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.701314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.701317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.801650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.801668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.801671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.890327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:35.901992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.902010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.902013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.002498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.002515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.002518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.103713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.103727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.103731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.203055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.203069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.203072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.306987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.307001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.307005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.406856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.406871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.406875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.508563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.508582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.508585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.608568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.608586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.608590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.708921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.708937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.708941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.809277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.809297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.809301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.909627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.909644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.909647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.011237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.011255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.011258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.112270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.112294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.112297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.212508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.212523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.212525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.312592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.312609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.312611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.412935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.412952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.412955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.513281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.513301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.513304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.613626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.613642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.613645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.713983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.713999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.714001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.814325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.814353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.814356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.914685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.914703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.914706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.015031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.015048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.015051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.115400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.115423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.115426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.215739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.215756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.215759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.316362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.316380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.316384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.417055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.417070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.417073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.520214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.520230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.520233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.619695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.619713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.619717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.720053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.720070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.720073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.820815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.820827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.820830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.920766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.920786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.920789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.021101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.021118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.021121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.121448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.121462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.121464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.221825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.221845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.221847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.322179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.322195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.322199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.426433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.426455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.426457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.526468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.526488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.526491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.631565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.631588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.631591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.731871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.731888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.731892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.832133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.832149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.832151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.938468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.938489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.938492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.038968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.038986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.038989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.139412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.139430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.139434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.239695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.239710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.239714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.342450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.342470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.342473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.442436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.442454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.442457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.542776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.542794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.542797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.643150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.643164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.643168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.743504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.743520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.743523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.843838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.843869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.843873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.890465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:40.944201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.944219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.944222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.044541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.044560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.044563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.144923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.144943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.144946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.245266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.245285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.245288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.345614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.345636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.345639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.446146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.446168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.446171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.546312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.546329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.546333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.646643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.646658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.646661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.747860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.747875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.747877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.847880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.847899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.847902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.948210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.948225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.948227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.048570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.048597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.048601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.148909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.148926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.148929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.249288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.249305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.249308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.349625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.349647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.349651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.450065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.450084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.450087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.550324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.550339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.550342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.650687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.650706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.650709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.751026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.751050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.751052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.851383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.851409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.851412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.951729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.951744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.951747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.052090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.052106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.052108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.152446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.152465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.152469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.252774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.252801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.252804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.353146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.353164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.353168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.453506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.453530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.453534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.554511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.554529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.554532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.654710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.654728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.654731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.755070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.755085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.755089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.858668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.858687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.858691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.959141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.959159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.959162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.059694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.059710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.059729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.160056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.160079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.160083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.260382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.260400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.260404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.360763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.360778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.360780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.461118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.461133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.461136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.562450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.562473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.562476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.662796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.662813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.662816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.763186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.763202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.763206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.863557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.863573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.863575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.964487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.964505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.964508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.064772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.064786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.064789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.165155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.165180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.165183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.265476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.265495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.265498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.365805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.365821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.365824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.466179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.466203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.466206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.567299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.567313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.567315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.668298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.668317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.668320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.768258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.768280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.768282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.868611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.868626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.868629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.890615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:45.968954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.968969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.968972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.069262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.069283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.069286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.174237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.174254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.174257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.277817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.277841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.277845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.382592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.382611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.382614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.482996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.483016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.483019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.586088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.586107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.586110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.686302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.686320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.686324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.786618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.786635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.786638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.886970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.886988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.886991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.987338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.987356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.987359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.087669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.087684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.087687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.187999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.188084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.188091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.288372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.288390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.288393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.389369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.389391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.389395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.489582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.489597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.489600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.589949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.589968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.589971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.690278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.690294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.690296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.790658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.790677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.790680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.891012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.891029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.891032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.991378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.991394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.991396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.091719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.091735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.091739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.192037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.192055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.192058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.292404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.292418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.292422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.392754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.392770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.392772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.493093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.493108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.493110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.593461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.593481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.593484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.693808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.693825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.693827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.794177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.794190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.794193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.894567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.894582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.894585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.994851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.994864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.994868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.095217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.095233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.095236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.198714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.198729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.198732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.299298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.299320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.299323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.399842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.399858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.399861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.500212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.500228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.500232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.600557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.600574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.600577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.700916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.700939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.700941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.801269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.801297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.801299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.901634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.901652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.901655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.002143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.002163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.002166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.102314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.102342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.102345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.202719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.202738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.202740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.304359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.304376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.304379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.404934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.404955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.404959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.505267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.505282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.505284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.605633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.605652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.605656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.705977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.705996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.705999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.814463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.814483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.814486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.865325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:06:50.865381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-01T14:06:50.865852Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:06:50.866225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:06:50.866357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:06:50.866507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-01T14:06:50.893608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:50.914359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.914394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.914397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.015974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.015987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.015990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.116080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.116101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.116104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.216447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.216468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.216472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.316758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.316773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.316775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.417148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.417165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.417167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.517483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.517502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.517505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.617842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.617858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.617860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.718207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.718230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.718233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.818553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.818573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.818576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.918924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.918943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.918947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.019265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.019283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.019288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.119612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.119629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.119633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.219964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.219987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.219991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.320923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.320945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.320948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.421473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.421497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.421500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.521525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.521547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.521550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.621875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.621898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.621902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.722233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.722253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.722257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.822588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.822606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.822610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.922934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.922951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.922954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.023283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.023303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.023305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.123623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.123641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.123644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.223997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.224016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.224020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.324353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.324372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.324376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.424746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.424763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.424766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.525072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.525091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.525095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.625411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.625433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.625436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.725749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.725771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.725774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.826106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.826125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.826127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.926712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.926731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.926735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.026823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.026840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.026844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.127086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.127105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.127108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.227797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.227813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.227817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.327852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.327872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.327875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.430436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.430453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.430456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.530615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.530636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.530639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.630934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.630950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.630953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.731313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.731331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.731334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.831663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.831695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.831698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.932016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.932036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.932039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.032375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.032394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.032397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.132753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.132769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.132773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.233082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.233103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.233107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.333855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.333872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.333876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.434286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.434305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.434309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.534623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.534642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.534645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.635229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.635250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.635253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.735344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.735362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.735364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.835696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.835714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.835717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.893664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:55.937629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.937647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.937650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.037931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.037949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.037952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.138320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.138364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.138409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.240053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.240070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.240072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.341217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.341232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.341234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.441421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.441444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.441448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.541732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.541752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.541755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.642089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.642103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.642105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.746479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.746498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.746502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.846919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.846954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.846958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.947253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.947274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.947277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.047699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.047719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.047724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.510423Z :SimpleHandlers INFO: Random seed for debugging is 1759327617510413
2025-10-01T14:06:57.640954Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556254582180143213:2089];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:57.640977Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/tmpvwS3jc/pdisk_1.dat
2025-10-01T14:06:57.642964Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556254582148867367:2165];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:57.642982Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:57.647846Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:57.648209Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:57.647819Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:57.648258Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:57.689249Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 23942, node 3
2025-10-01T14:06:57.718645Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/yandexW1oETh.tmp
2025-10-01T14:06:57.718658Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/yandexW1oETh.tmp
2025-10-01T14:06:57.718716Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004782/r3tmp/yandexW1oETh.tmp
2025-10-01T14:06:57.718763Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:57.721868Z INFO: TTestServer started on Port 24319 GrpcPort 23942
TClient is connected to server localhost:24319
PQClient connected to localhost:23942
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-01T14:06:57.745852Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:57.745890Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:57.746817Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:57.746843Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:57.747330Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:57.747885Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:06:57.748172Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:57.752215Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-10-01T14:06:57.806752Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720659, at schemeshard: 72057594046644480
2025-10-01T14:06:57.807959Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
2025-10-01T14:06:57.938475Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:58.076012Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254586475111460:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:58.076030Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254586475111435:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:58.076040Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:58.077018Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:58.080523Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254586475111493:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:58.080563Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:58.083563Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:58.091834Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556254586475111464:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:58.097548Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556254586443834891:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:58.099349Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=NGVjMWQxNWUtNDA2ZWVkNDctMTMxYjNlMDMtNGYwMWE0ZWM=, ActorId: [4:7556254586443834841:2293], ActorState: ExecuteState, TraceId: 01k6g1j119324g4ekfq7y05r7f, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:58.099555Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:58.139432Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:58.165498Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556254586475111792:2849] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:58.173218Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:58.183845Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556254586475111823:2356], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:58.184701Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=YjA4Y2FjOGMtNTdkYzU1ZWYtODc5OTQ2ZDEtMzQ1ZDMzMDA=, ActorId: [3:7556254586475111431:2322], ActorState: ExecuteState, TraceId: 01k6g1j10v39j8140e67d09fj3, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:58.184842Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:23942", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:58.221659Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1j14s9k0jahmkaznrsy7a, Database: , SessionId: ydb://session/3?node_id=3&id=ZmMwMzZlMDMtOWE1ZDZjMzctZTQ1MTg4NzQtYTBiMDA5NWE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254586475111947:2947] 
2025-10-01T14:06:58.646043Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:58.650486Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:07:02.641202Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556254582180143213:2089];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:07:02.641241Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:07:02.643203Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556254582148867367:2165];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:07:02.643254Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:07:03.500183Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:23942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:23942
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-10-01T14:07:03.517953Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:07:03.527920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:03.527981Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254607949948941:3255] connected; active server actors: 1
2025-10-01T14:07:03.528052Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:07:03.528179Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:07:03.528668Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:07:03.530464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:03.530553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:07:03.530562Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:03.530577Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:07:03.531071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254607949948968:2451], now have 1 active actors on pipe
2025-10-01T14:07:03.531083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254607949948940:3254], now have 1 active actors on pipe
2025-10-01T14:07:03.531192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:03.531210Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-01T14:07:03.541820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:03.547763Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254607949949003:3302], now have 1 active actors on pipe
2025-10-01T14:07:03.548287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:03.549529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:03.549697Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:03.549707Z node 4 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:07:03.549764Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:03.549792Z node 4 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7556254607918671924:2393]
2025-10-01T14:07:03.550613Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:03.550617Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:03.550622Z node 4 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7556254607918671924:2393]
2025-10-01T14:07:03.550629Z node 4 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:07:03.550929Z node 4 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:07:03.550940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.550954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.550957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:03.550961Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:07:03.550963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.550964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.550966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:07:03.550973Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:03.551039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:03.551063Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:03.553019Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:03.553059Z node 4 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327623592, TxId 281474976720679
2025-10-01T14:07:03.553064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.553066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.553091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.553132Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:03.553786Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1j6b97kpes5894nev4s66, Database: , SessionId: ydb://session/3?node_id=3&id=OGU1MzZiMWUtMzczZGYzN2MtMTFhZDM0YTAtNzYwZTAzMzg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:07:03.555623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:03.555692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:03.555701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.555703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.555704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.555711Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:03.555826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:07:03.555845Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:03.555894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:03.559672Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:07:03.559698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:07:03.560805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327623592
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327623592
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:23942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:07:03.567765Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:07:03.651345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.651373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.651376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.751879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.751897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.751901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.852091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.852112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.852116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.952418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.952435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.952438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.052782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.052796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.052799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:07:04.069088Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:07:04.153143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.153159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.153162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.255780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.255797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.255799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.355883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.355900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.355902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.456234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.456263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.456265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.556616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.556634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.556638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:07:04.571804Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:07:04.582497Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:07:04.582787Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:07:04.582795Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:23942
2025-10-01T14:07:04.583476Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:04.583501Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:07:04.585000Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:07:04.586478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:07:04.586523Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40934
2025-10-01T14:07:04.586528Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40934 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:04.586533Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:04.586988Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:07:04.587020Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:04.587025Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:04.587028Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:04.587033Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:04.587496Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:04.612633Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:07:04.612866Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916510:2488] connected; active server actors: 1
2025-10-01T14:07:04.612884Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:07:04.612888Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.612964Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916510:2488] disconnected; active server actors: 1
2025-10-01T14:07:04.612967Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916510:2488] disconnected no session
2025-10-01T14:07:04.635125Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.635145Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:07:04.635149Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254612244916475:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.635159Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.636934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254612244916532:2488], now have 1 active actors on pipe
2025-10-01T14:07:04.641579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-01T14:07:04.641779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.641805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.641844Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:07:04.641868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.641881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.641884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.641899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.641917Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.641939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.642499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.642516Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.642537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.643239Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327624643 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:04.643289Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.643403Z :INFO: [] MessageGroupId [src] SessionId [src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0] Write session: close. Timeout = 0 ms
2025-10-01T14:07:04.643409Z :INFO: [] MessageGroupId [src] SessionId [src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0] Write session will now close
2025-10-01T14:07:04.643413Z :DEBUG: [] MessageGroupId [src] SessionId [src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0] Write session: aborting
2025-10-01T14:07:04.643508Z :INFO: [] MessageGroupId [src] SessionId [src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:07:04.643512Z :DEBUG: [] MessageGroupId [src] SessionId [src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0] Write session: destroy
2025-10-01T14:07:04.642710Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0
2025-10-01T14:07:04.643663Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0 grpc read done: success: 0 data: 
2025-10-01T14:07:04.643667Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0 grpc read failed
2025-10-01T14:07:04.643673Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0 grpc closed
2025-10-01T14:07:04.643679Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c303fb4b-bbc8fe84-4e3f2ee0-78c46c65_0 is DEAD
2025-10-01T14:07:04.643867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:07:04.644222Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254612244916532:2488] destroyed
2025-10-01T14:07:04.644248Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:07:04.644258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.644262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.644264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Session was created
2025-10-01T14:07:04.656921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.656939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.656942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:07:04.704823Z :INFO: [/Root] [] [d8942b52-c75481da-7cb9f09-6b3bb400] Open read subsessions to databases: { name: dc1, endpoint: localhost:23942, path: /Root }, { name: dc2, endpoint: localhost:23942, path: /Root }, { name: dc3, endpoint: localhost:23942, path: /Root }
2025-10-01T14:07:04.706955Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Starting read session
2025-10-01T14:07:04.706965Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Starting single session
2025-10-01T14:07:04.707206Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.707212Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.707217Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:07:04.707806Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Starting read session
2025-10-01T14:07:04.707813Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Starting single session
2025-10-01T14:07:04.707833Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.707839Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.707842Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:07:04.707896Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Starting read session
2025-10-01T14:07:04.707899Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Starting single session
2025-10-01T14:07:04.707913Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.707916Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.707918Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:07:04.757280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.757298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.757301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.857615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.857649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.857652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.925599Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] Successfully connected. Initializing session
2025-10-01T14:07:04.925822Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Successfully connected. Initializing session
2025-10-01T14:07:04.925884Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] Successfully connected. Initializing session
2025-10-01T14:07:04.926843Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:04.926853Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-01T14:07:04.926875Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:04.926876Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-01T14:07:04.926883Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:04.926884Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-01T14:07:04.931009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-01T14:07:04.931160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-01T14:07:04.931181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:23942
2025-10-01T14:07:04.932695Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:04.932773Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read init: from# ipv6:[::1]:40954, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:04.932884Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:04.932898Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 read init: from# ipv6:[::1]:40954, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:04.932949Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 auth for : user
2025-10-01T14:07:04.932984Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 auth for : user
2025-10-01T14:07:04.933025Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:04.933082Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 read init: from# ipv6:[::1]:40954, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:04.933144Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Handle describe topics response
2025-10-01T14:07:04.933157Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 auth is DEAD
2025-10-01T14:07:04.933168Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:04.933337Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 auth for : user
2025-10-01T14:07:04.933417Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:04.933419Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 Handle describe topics response
2025-10-01T14:07:04.933435Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 auth is DEAD
2025-10-01T14:07:04.933447Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 Handle describe topics response
2025-10-01T14:07:04.933449Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:04.933454Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 auth is DEAD
2025-10-01T14:07:04.933460Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:04.933607Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:04.933629Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:04.933800Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916568:2505] connected; active server actors: 1
2025-10-01T14:07:04.933811Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916566:2506] connected; active server actors: 1
2025-10-01T14:07:04.933815Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916569:2507] connected; active server actors: 1
2025-10-01T14:07:04.933819Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556254612244916566:2506] session shared/user_3_2_16680753683149146617_v1
2025-10-01T14:07:04.933827Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:07:04.933836Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:07:04.933842Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_16680753683149146617_v1" (Sender=[3:7556254612244916556:2506], Pipe=[3:7556254612244916566:2506], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:04.933845Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:04.933850Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556254612244916568:2505] session shared/user_3_1_12422149058125272650_v1
2025-10-01T14:07:04.933855Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_12422149058125272650_v1" (Sender=[3:7556254612244916555:2505], Pipe=[3:7556254612244916568:2505], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:04.933864Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:04.933872Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_16680753683149146617_v1" (Sender=[3:7556254612244916556:2506], Pipe=[3:7556254612244916566:2506], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:04.933886Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_16680753683149146617_v1" sender [3:7556254612244916556:2506] lock partition 0 for ReadingSession "shared/user_3_2_16680753683149146617_v1" (Sender=[3:7556254612244916556:2506], Pipe=[3:7556254612244916566:2506], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-01T14:07:04.933897Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-01T14:07:04.933902Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-01T14:07:04.933905Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7556254612244916569:2507] session shared/user_3_3_13839204300470945875_v1
2025-10-01T14:07:04.933909Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_13839204300470945875_v1" (Sender=[3:7556254612244916557:2507], Pipe=[3:7556254612244916569:2507], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:04.933912Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:04.933915Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-01T14:07:04.933918Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-01T14:07:04.933921Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000004s
2025-10-01T14:07:04.934135Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_2_16680753683149146617_v1" ClientId: "user" PipeClient { RawX1: 7556254612244916566 RawX2: 4503612512274890 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:07:04.934165Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:04.934522Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254612244916574:2516], now have 1 active actors on pipe
2025-10-01T14:07:04.934878Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7556254612244916574:2516]
2025-10-01T14:07:04.934973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.934990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.935007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_2_16680753683149146617_v1 on pipe: [3:7556254612244916574:2516]
2025-10-01T14:07:04.935043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.935049Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_2_16680753683149146617_v1:1 with generation 1
2025-10-01T14:07:04.935053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.935057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.935091Z node 4 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_2_16680753683149146617_v1
2025-10-01T14:07:04.935098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.935138Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.935157Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got InitResponse. ReadSessionId: shared/user_3_2_16680753683149146617_v1
2025-10-01T14:07:04.935169Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.935170Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] Got InitResponse. ReadSessionId: shared/user_3_3_13839204300470945875_v1
2025-10-01T14:07:04.935181Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.935215Z :DEBUG: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.935233Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.935234Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] Got InitResponse. ReadSessionId: shared/user_3_1_12422149058125272650_v1
2025-10-01T14:07:04.935241Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:04.935256Z :DEBUG: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.935356Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:04.935349Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:07:04.935368Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-01T14:07:04.935400Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# ea9f9a38-64320270-c0c80033-e98f5672
2025-10-01T14:07:04.935423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.935417Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:07:04.935421Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:07:04.935430Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 got read request: guid# d0d211a4-15e379fb-bd8c451a-c113e542
2025-10-01T14:07:04.935437Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 got read request: guid# 3c489c67-c4ef7dd1-f9fcc1da-91ffa7cc
2025-10-01T14:07:04.935578Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.935604Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40954
2025-10-01T14:07:04.935613Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40954 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:04.935616Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:04.936172Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-01T14:07:04.936205Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:04.936210Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:04.936211Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:04.936215Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:04.936576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.936612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.936620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.936623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.936624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.936630Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:07:04.936643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:07:04.936745Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:04.936769Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327624857 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:07:04.936786Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:07:04.936819Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 sending to client partition status
2025-10-01T14:07:04.937109Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-01T14:07:04.938574Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-01T14:07:04.938674Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-01T14:07:04.938691Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-01T14:07:04.938698Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-01T14:07:04.938947Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:07:04.939022Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916597:2517] connected; active server actors: 1
2025-10-01T14:07:04.939048Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-01T14:07:04.939059Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.939139Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916597:2517] disconnected; active server actors: 1
2025-10-01T14:07:04.939147Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916597:2517] disconnected no session
2025-10-01T14:07:04.942720Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.942735Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:07:04.942738Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254612244916578:2517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.942747Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.943182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-01T14:07:04.943631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254612244916613:2517], now have 1 active actors on pipe
2025-10-01T14:07:04.943664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.943673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.943704Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:04.943721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.943727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.943730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.943746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.943762Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.943782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.944028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.944050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.944074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.944266Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0
2025-10-01T14:07:04.944646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327624944 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:04.944686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.944842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 1 to 1
2025-10-01T14:07:04.944881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.944890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-01T14:07:04.945023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 2 to 2
2025-10-01T14:07:04.945037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-01T14:07:04.945082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 3 to 3
2025-10-01T14:07:04.945086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-01T14:07:04.945123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 4 to 4
2025-10-01T14:07:04.945128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-01T14:07:04.945158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 5 to 5
2025-10-01T14:07:04.945162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-01T14:07:04.945199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 6 to 6
2025-10-01T14:07:04.945205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-01T14:07:04.945235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 7 to 7
2025-10-01T14:07:04.945239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-01T14:07:04.945271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 8 to 8
2025-10-01T14:07:04.945297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-01T14:07:04.945331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 9 to 9
2025-10-01T14:07:04.945338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-01T14:07:04.945345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 10 to 10
2025-10-01T14:07:04.945350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-01T14:07:04.945357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 11 to 11
2025-10-01T14:07:04.945363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-01T14:07:04.945369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 12 to 12
2025-10-01T14:07:04.945376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-01T14:07:04.945383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 13 to 13
2025-10-01T14:07:04.945390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-01T14:07:04.945398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 14 to 14
2025-10-01T14:07:04.945404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-01T14:07:04.945411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 15 to 15
2025-10-01T14:07:04.945415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-01T14:07:04.945422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 16 to 16
2025-10-01T14:07:04.945429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-01T14:07:04.945435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 17 to 17
2025-10-01T14:07:04.945441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-01T14:07:04.945448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 18 to 18
2025-10-01T14:07:04.945453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-01T14:07:04.945460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 19 to 19
2025-10-01T14:07:04.945466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-01T14:07:04.945473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 20 to 20
2025-10-01T14:07:04.945479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-01T14:07:04.945486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 21 to 21
2025-10-01T14:07:04.945492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-01T14:07:04.945498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 22 to 22
2025-10-01T14:07:04.945503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-01T14:07:04.945522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 23 to 23
2025-10-01T14:07:04.945529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-01T14:07:04.945535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 24 to 24
2025-10-01T14:07:04.945541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-01T14:07:04.945548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 25 to 25
2025-10-01T14:07:04.945553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-01T14:07:04.945560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 26 to 26
2025-10-01T14:07:04.945566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-01T14:07:04.945574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 27 to 27
2025-10-01T14:07:04.945585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-01T14:07:04.945601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 28 to 28
2025-10-01T14:07:04.945606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-01T14:07:04.945612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 29 to 29
2025-10-01T14:07:04.945628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-01T14:07:04.945637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 30 to 30
2025-10-01T14:07:04.945642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-01T14:07:04.945649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 31 to 31
2025-10-01T14:07:04.945653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-01T14:07:04.945661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 32 to 32
2025-10-01T14:07:04.945666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-01T14:07:04.945673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 33 to 33
2025-10-01T14:07:04.945679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-01T14:07:04.945686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 34 to 34
2025-10-01T14:07:04.945691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-01T14:07:04.945697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 35 to 35
2025-10-01T14:07:04.945703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-01T14:07:04.945708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 36 to 36
2025-10-01T14:07:04.945715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-01T14:07:04.945721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 37 to 37
2025-10-01T14:07:04.945725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-01T14:07:04.945731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 38 to 38
2025-10-01T14:07:04.945735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-01T14:07:04.945742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 39 to 39
2025-10-01T14:07:04.945747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:04.945754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 40 to 40
2025-10-01T14:07:04.945759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-01T14:07:04.945765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 41 to 41
2025-10-01T14:07:04.945771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-01T14:07:04.945779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 42 to 42
2025-10-01T14:07:04.945786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-01T14:07:04.945793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 43 to 43
2025-10-01T14:07:04.945799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-01T14:07:04.945806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 44 to 44
2025-10-01T14:07:04.945814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-01T14:07:04.945895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 45 to 45
2025-10-01T14:07:04.945902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-01T14:07:04.945917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 46 to 46
2025-10-01T14:07:04.945954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-01T14:07:04.945968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 47 to 47
2025-10-01T14:07:04.945972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-01T14:07:04.945985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 48 to 48
2025-10-01T14:07:04.945990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.945992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-01T14:07:04.946003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 49 to 49
2025-10-01T14:07:04.946013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.946015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-01T14:07:04.946989Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.947090Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.947204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 50 to 50
2025-10-01T14:07:04.947228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-01T14:07:04.947244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 51 to 51
2025-10-01T14:07:04.947250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-01T14:07:04.947261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 52 to 52
2025-10-01T14:07:04.947267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-01T14:07:04.947289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 53 to 53
2025-10-01T14:07:04.947295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-01T14:07:04.947304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 54 to 54
2025-10-01T14:07:04.947310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-01T14:07:04.947319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 55 to 55
2025-10-01T14:07:04.947324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-01T14:07:04.947333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 56 to 56
2025-10-01T14:07:04.947342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-01T14:07:04.947352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 57 to 57
2025-10-01T14:07:04.947358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-01T14:07:04.947368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 58 to 58
2025-10-01T14:07:04.947374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-01T14:07:04.947384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 59 to 59
2025-10-01T14:07:04.947394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-01T14:07:04.947403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 60 to 60
2025-10-01T14:07:04.947413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 60
2025-10-01T14:07:04.947455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 61 to 61
2025-10-01T14:07:04.947464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 61
2025-10-01T14:07:04.947475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 62 to 62
2025-10-01T14:07:04.947482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 62
2025-10-01T14:07:04.947492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 63 to 63
2025-10-01T14:07:04.947501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 63
2025-10-01T14:07:04.947512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 64 to 64
2025-10-01T14:07:04.947521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 64
2025-10-01T14:07:04.947554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 65 to 65
2025-10-01T14:07:04.947414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.947561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.947563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 65
2025-10-01T14:07:04.947451Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.947455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.947572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 66 to 66
2025-10-01T14:07:04.947483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:04.947500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-10-01T14:07:04.947580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 66
2025-10-01T14:07:04.947592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 67 to 67
2025-10-01T14:07:04.947598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 67
2025-10-01T14:07:04.947607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 68 to 68
2025-10-01T14:07:04.947614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.947616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 68
2025-10-01T14:07:04.947133Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.947654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 69 to 69
2025-10-01T14:07:04.947210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.947555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.947576Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.947726Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.947797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.947838Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.947872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.948346Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.948356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.948369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.948449Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.947814Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.947822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.947961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 2 size 82 offset: -1
2025-10-01T14:07:04.947973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.947975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.947981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 192 offset: -1
2025-10-01T14:07:04.947987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.947989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.948537Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.947995Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.947997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.948562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.948005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.948022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.948031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.948034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.948075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:07:04.948116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 156 count 1 nextOffset 1 batches 1
2025-10-01T14:07:04.948124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.948768Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.948186Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 142 WTime 1759327624948
2025-10-01T14:07:04.948206Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.948212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.948224Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.948234Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 142
2025-10-01T14:07:04.948245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-01T14:07:04.948260Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 4
2025-10-01T14:07:04.948695Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.948702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.948714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 6 size 303 offset: -1
2025-10-01T14:07:04.948723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.948727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.948731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size 413 offset: -1
2025-10-01T14:07:04.948737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.948739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.948745Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.948755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.948757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.948760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.948768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-01T14:07:04.948845Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.948886Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.948905Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.949061Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.949197Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.949297Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.949305Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949451Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 13 size 523 offset: -1
2025-10-01T14:07:04.949474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949494Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.949506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.949517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 6
2025-10-01T14:07:04.949538Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 7
2025-10-01T14:07:04.949545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 8
2025-10-01T14:07:04.949548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 9
2025-10-01T14:07:04.949551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 10
2025-10-01T14:07:04.949499Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949552Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949581Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949645Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.949688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.949699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.949704Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.949709Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.949717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.947664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 69
2025-10-01T14:07:04.949862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 70 to 70
2025-10-01T14:07:04.949879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 70
2025-10-01T14:07:04.949892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 71 to 71
2025-10-01T14:07:04.949899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 71
2025-10-01T14:07:04.949909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 72 to 72
2025-10-01T14:07:04.949828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 15 size 633 offset: -1
2025-10-01T14:07:04.949862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949864Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 72
2025-10-01T14:07:04.949868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 16 size 743 offset: -1
2025-10-01T14:07:04.949874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 73 to 73
2025-10-01T14:07:04.949879Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 17 size 853 offset: -1
2025-10-01T14:07:04.949886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 73
2025-10-01T14:07:04.949895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 18 size 963 offset: -1
2025-10-01T14:07:04.949952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 74 to 74
2025-10-01T14:07:04.949902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.949960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 74
2025-10-01T14:07:04.949908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size 1073 offset: -1
2025-10-01T14:07:04.949914Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.949966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 75 to 75
2025-10-01T14:07:04.949924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.949971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 75
2025-10-01T14:07:04.949981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 76 to 76
2025-10-01T14:07:04.949991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.949993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 76
2025-10-01T14:07:04.949983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 77 to 77
2025-10-01T14:07:04.949998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950004Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.950008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.950012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950019Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950021Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.950023Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.950026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.950033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.949760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.949770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.950041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.949773Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.949787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.949793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.949798Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950043Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.950045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.950058Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 142 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.950085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.950100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 89 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.950107Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.950114Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-01T14:07:04.950118Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 142
2025-10-01T14:07:04.950158Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:04.950164Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:04.950168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.950178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.950181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-10-01T14:07:04.950199Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-01T14:07:04.950231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 266 count 1 nextOffset 2 batches 1
2025-10-01T14:07:04.950243Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-01T14:07:04.950247Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 611 count 2 nextOffset 3 batches 1
2025-10-01T14:07:04.950251Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-01T14:07:04.950256Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1066 count 3 nextOffset 4 batches 1
2025-10-01T14:07:04.950264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-01T14:07:04.950268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1631 count 4 nextOffset 5 batches 1
2025-10-01T14:07:04.950271Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-01T14:07:04.950276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2306 count 5 nextOffset 6 batches 1
2025-10-01T14:07:04.950283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-01T14:07:04.950287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3091 count 6 nextOffset 7 batches 1
2025-10-01T14:07:04.950291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-01T14:07:04.950295Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3986 count 7 nextOffset 8 batches 1
2025-10-01T14:07:04.950298Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-01T14:07:04.950302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 4991 count 8 nextOffset 9 batches 1
2025-10-01T14:07:04.950304Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-01T14:07:04.950309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6106 count 9 nextOffset 10 batches 1
2025-10-01T14:07:04.950311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.950354Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,9 HeadOffset 1 endOffset 1 curOffset 10 d0000000000_00000000000000000001_00000_0000000009_00000? size 5877 WTime 1759327624950
2025-10-01T14:07:04.950393Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.950399Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 142 bytes (142)
2025-10-01T14:07:04.950403Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 142 (8388608)
2025-10-01T14:07:04.950410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-01T14:07:04.950418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 12
2025-10-01T14:07:04.950419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 13
2025-10-01T14:07:04.950423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 14
2025-10-01T14:07:04.950424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 15
2025-10-01T14:07:04.950429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-10-01T14:07:04.950437Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.950449Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 9 size 5877
2025-10-01T14:07:04.950509Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:07:04.950526Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:07:04.950529Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:04.950562Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.950570Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-01T14:07:04.950585Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.950595Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-01T14:07:04.950609Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327624948 queuesize 0 startOffset 0
2025-10-01T14:07:04.950390Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.950463Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-01T14:07:04.950466Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-01T14:07:04.950485Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 142
2025-10-01T14:07:04.950488Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.950502Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 8732de04-63c0b150-cac55e27-411e79b6, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 170, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.950541Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950559Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950563Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950706Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 170 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 8732de04-63c0b150-cac55e27-411e79b6
2025-10-01T14:07:04.950871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950888Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-01T14:07:04.950893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 25 size 1183 offset: -1
2025-10-01T14:07:04.950958Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.950904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951029Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.951059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.951065Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.950910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 26 size 1293 offset: -1
2025-10-01T14:07:04.951079Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 27 size 1403 offset: -1
2025-10-01T14:07:04.950929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 28 size 1513 offset: -1
2025-10-01T14:07:04.950940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size 1623 offset: -1
2025-10-01T14:07:04.951166Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.950951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.950952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.950957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951176Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.950958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.950973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951381Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 82 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1759327624948 CreateTimestampMS: 1759327624944 UncompressedSize: 11 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-01T14:07:04.951422Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-01T14:07:04.950974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951430Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 8732de04-63c0b150-cac55e27-411e79b6 has messages 1
2025-10-01T14:07:04.950983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951452Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 8732de04-63c0b150-cac55e27-411e79b6, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 171
2025-10-01T14:07:04.950991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951460Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 8732de04-63c0b150-cac55e27-411e79b6
2025-10-01T14:07:04.950993Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.950996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.950998Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951019Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-01T14:07:04.951031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 17
2025-10-01T14:07:04.951040Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 170 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:07:04.951057Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:07:04.951060Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-01T14:07:04.951068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951080Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 1 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.951091Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-01T14:07:04.951102Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.951509Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951524Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.951110Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-01T14:07:04.951534Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.951112Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-01T14:07:04.951133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 18
2025-10-01T14:07:04.951140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.951178Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951182Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 33 size 1733 offset: -1
2025-10-01T14:07:04.951198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 34 size 1843 offset: -1
2025-10-01T14:07:04.951211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951230Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951238Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 19
2025-10-01T14:07:04.951252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 20
2025-10-01T14:07:04.951587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.951619Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951629Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.951666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.951676Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.950029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 77
2025-10-01T14:07:04.951705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.951714Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.951758Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 171, now ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-01T14:07:04.951757Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 78 to 78
2025-10-01T14:07:04.951799Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-01T14:07:04.951806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.951811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 78
2025-10-01T14:07:04.951819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 79 to 79
2025-10-01T14:07:04.951824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.951826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 79
2025-10-01T14:07:04.951813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951833Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 37 size 1953 offset: -1
2025-10-01T14:07:04.951848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951874Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-01T14:07:04.951854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951882Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 171 to budget
2025-10-01T14:07:04.951869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 39 size 2063 offset: -1
2025-10-01T14:07:04.951885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951888Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 171, ReadSizeServerDelta = 524117
2025-10-01T14:07:04.951888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 40 size 2173 offset: -1
2025-10-01T14:07:04.951897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951909Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.951925Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.951834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 80 to 80
2025-10-01T14:07:04.951929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.951941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.951948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.951950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 80
2025-10-01T14:07:04.951973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 81 to 81
2025-10-01T14:07:04.951981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.951983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 81
2025-10-01T14:07:04.951994Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.951812Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952009Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-01T14:07:04.951872Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951902Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.951927Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-01T14:07:04.952050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 21
2025-10-01T14:07:04.952072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 22
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..11 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-01T14:07:04.944000Z WriteTime: 2025-10-01T14:07:04.948000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.952077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 23
2025-10-01T14:07:04.952079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 24
2025-10-01T14:07:04.952081Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 25
2025-10-01T14:07:04.952103Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 1, size 11 bytes
2025-10-01T14:07:04.952106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 82 to 82
2025-10-01T14:07:04.952116Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.952119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 82
2025-10-01T14:07:04.952143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 83 to 83
2025-10-01T14:07:04.952154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 83
2025-10-01T14:07:04.952179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 84 to 84
2025-10-01T14:07:04.952189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 84
2025-10-01T14:07:04.952202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 85 to 85
2025-10-01T14:07:04.952195Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 85
2025-10-01T14:07:04.952212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 86 to 86
2025-10-01T14:07:04.952229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 86
2025-10-01T14:07:04.952241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 87 to 87
2025-10-01T14:07:04.952246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 87
2025-10-01T14:07:04.952264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 88 to 88
2025-10-01T14:07:04.952255Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952267Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 88
2025-10-01T14:07:04.952272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 89 to 89
2025-10-01T14:07:04.952298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 89
2025-10-01T14:07:04.952309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 90 to 90
2025-10-01T14:07:04.952315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 90
2025-10-01T14:07:04.952314Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 91 to 91
2025-10-01T14:07:04.952329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 45 size 2283 offset: -1
2025-10-01T14:07:04.952336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 91
2025-10-01T14:07:04.952347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 92 to 92
2025-10-01T14:07:04.952352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 46 size 2393 offset: -1
2025-10-01T14:07:04.952363Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 47 size 2503 offset: -1
2025-10-01T14:07:04.952370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 92
2025-10-01T14:07:04.952390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 48 size 2613 offset: -1
2025-10-01T14:07:04.952403Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size 2723 offset: -1
2025-10-01T14:07:04.952411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952416Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 93 to 93
2025-10-01T14:07:04.952418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 93
2025-10-01T14:07:04.952427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952476Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952545Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 171 } }
2025-10-01T14:07:04.952547Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952588Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952596Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 2e72ff63-a056253a-659db45d-8173d606
2025-10-01T14:07:04.952538Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-01T14:07:04.952563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 27
2025-10-01T14:07:04.952566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 28
2025-10-01T14:07:04.952568Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 29
2025-10-01T14:07:04.952570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 30
2025-10-01T14:07:04.952646Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952739Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952758Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952763Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952859Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 94 to 94
2025-10-01T14:07:04.952953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.952957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 94
2025-10-01T14:07:04.953018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 95 to 95
2025-10-01T14:07:04.953026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 95
2025-10-01T14:07:04.953052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 96 to 96
2025-10-01T14:07:04.953057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 96
2025-10-01T14:07:04.953069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 97 to 97
2025-10-01T14:07:04.953100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 97
2025-10-01T14:07:04.953112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 98 to 98
2025-10-01T14:07:04.953125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 98
2025-10-01T14:07:04.953138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 99 to 99
2025-10-01T14:07:04.953144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 99
2025-10-01T14:07:04.953169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 100 to 100
2025-10-01T14:07:04.953174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 100
2025-10-01T14:07:04.953163Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-01T14:07:04.953172Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 10
2025-10-01T14:07:04.953186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 101 to 101
2025-10-01T14:07:04.953185Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 10, WTime# 1759327624948, sizeLag# 5877
2025-10-01T14:07:04.953188Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.953204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 101
2025-10-01T14:07:04.953201Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 8c040e87-8d3bc128-c162d068-2ca741e8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 7052, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.953216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 102 to 102
2025-10-01T14:07:04.953226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 102
2025-10-01T14:07:04.953218Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 7052 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 8c040e87-8d3bc128-c162d068-2ca741e8
2025-10-01T14:07:04.953238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 103 to 103
2025-10-01T14:07:04.953245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 103
2025-10-01T14:07:04.953264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 104 to 104
2025-10-01T14:07:04.953272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 104
2025-10-01T14:07:04.953284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 105 to 105
2025-10-01T14:07:04.953297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 105
2025-10-01T14:07:04.953309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 106 to 106
2025-10-01T14:07:04.953320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 106
2025-10-01T14:07:04.953331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 107 to 107
2025-10-01T14:07:04.953353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 107
2025-10-01T14:07:04.953389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 108 to 108
2025-10-01T14:07:04.953398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 108
2025-10-01T14:07:04.953409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 109 to 109
2025-10-01T14:07:04.953417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 109
2025-10-01T14:07:04.953429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 110 to 110
2025-10-01T14:07:04.953443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 110
2025-10-01T14:07:04.953456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 111 to 111
2025-10-01T14:07:04.953475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 111
2025-10-01T14:07:04.953497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 112 to 112
2025-10-01T14:07:04.953504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 112
2025-10-01T14:07:04.953519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 113 to 113
2025-10-01T14:07:04.953529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953503Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953528Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953538Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953542Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953547Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953570Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953603Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.953609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953614Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953619Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.953813Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952878Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 55 size 2833 offset: -1
2025-10-01T14:07:04.952885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952891Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 56 size 2943 offset: -1
2025-10-01T14:07:04.952900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 57 size 3053 offset: -1
2025-10-01T14:07:04.952912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953964Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.952919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 58 size 3163 offset: -1
2025-10-01T14:07:04.952925Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size 3273 offset: -1
2025-10-01T14:07:04.952936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952951Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 9 size 5877 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.952969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953977Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 1 Data: "... 192 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1759327624949 CreateTimestampMS: 1759327624945 UncompressedSize: 121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 303 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 413 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 523 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 633 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 743 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 853 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 963 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 1073 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1759327624950 CreateTimestampMS: 1759327624945 UncompressedSize: 1001 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551419 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 1 }
2025-10-01T14:07:04.952971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953980Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.952975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952977Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952980Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 9 parts 0 suffix '63' size 5877
2025-10-01T14:07:04.952982Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.952983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.952987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.954019Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 10
2025-10-01T14:07:04.954026Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid 8c040e87-8d3bc128-c162d068-2ca741e8 has messages 1
2025-10-01T14:07:04.954038Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.954052Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 8c040e87-8d3bc128-c162d068-2ca741e8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 5610
2025-10-01T14:07:04.954058Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 8c040e87-8d3bc128-c162d068-2ca741e8
2025-10-01T14:07:04.954094Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.953531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 113
2025-10-01T14:07:04.954164Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.954184Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.952994Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.952997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.952999Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953004Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.953025Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 5759 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.954244Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.954257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 114 to 114
2025-10-01T14:07:04.953030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.954267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-01T14:07:04.953038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.954289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 114
2025-10-01T14:07:04.953040Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-01T14:07:04.953041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.953043Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-01T14:07:04.954261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.954302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 115 to 115
2025-10-01T14:07:04.953045Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.954308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953047Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-01T14:07:04.954311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 115
2025-10-01T14:07:04.954277Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.954305Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.953048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.953050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-01T14:07:04.953052Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.953054Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-01T14:07:04.953056Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.953058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-01T14:07:04.953059Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.954338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 116 to 116
2025-10-01T14:07:04.953061Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-01T14:07:04.953062Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.954343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953064Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-01T14:07:04.954346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 116
2025-10-01T14:07:04.953088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.953099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.953101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-01T14:07:04.953119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-01T14:07:04.954328Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.953143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1257 count 1 nextOffset 11 batches 1
2025-10-01T14:07:04.954350Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.953149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-01T14:07:04.954358Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.954365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 117 to 117
2025-10-01T14:07:04.953152Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2592 count 2 nextOffset 12 batches 1
2025-10-01T14:07:04.954396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.954404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 117
2025-10-01T14:07:04.953155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-01T14:07:04.953159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 4037 count 3 nextOffset 13 batches 1
2025-10-01T14:07:04.953162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-01T14:07:04.953167Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 5592 count 4 nextOffset 14 batches 1
2025-10-01T14:07:04.953170Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-01T14:07:04.954419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 118 to 118
2025-10-01T14:07:04.953173Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 7257 count 5 nextOffset 15 batches 1
2025-10-01T14:07:04.953176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-01T14:07:04.954422Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 5610, now ReadSizeBudget = 0, ReadSizeServerDelta = 518678
2025-10-01T14:07:04.954429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.954432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 118
2025-10-01T14:07:04.953180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 9032 count 6 nextOffset 16 batches 1
2025-10-01T14:07:04.953182Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-01T14:07:04.953186Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 10917 count 7 nextOffset 17 batches 1
2025-10-01T14:07:04.953189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-01T14:07:04.953193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 12912 count 8 nextOffset 18 batches 1
2025-10-01T14:07:04.953195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-01T14:07:04.954452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 119 to 119
2025-10-01T14:07:04.953203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 15017 count 9 nextOffset 19 batches 1
2025-10-01T14:07:04.953205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-01T14:07:04.954457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953209Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 17232 count 10 nextOffset 20 batches 1
2025-10-01T14:07:04.954460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 119
2025-10-01T14:07:04.953211Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-01T14:07:04.953215Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 19557 count 11 nextOffset 21 batches 1
2025-10-01T14:07:04.953217Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-01T14:07:04.953221Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 21992 count 12 nextOffset 22 batches 1
2025-10-01T14:07:04.954470Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 518678
2025-10-01T14:07:04.953223Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-01T14:07:04.954483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 120 to 120
2025-10-01T14:07:04.953227Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 24537 count 13 nextOffset 23 batches 1
2025-10-01T14:07:04.953230Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-01T14:07:04.954492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.953234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 27192 count 14 nextOffset 24 batches 1
2025-10-01T14:07:04.953237Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-01T14:07:04.954518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 120
2025-10-01T14:07:04.953241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 29957 count 15 nextOffset 25 batches 1
2025-10-01T14:07:04.953244Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-01T14:07:04.953247Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 32832 count 16 nextOffset 26 batches 1
2025-10-01T14:07:04.953250Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-01T14:07:04.953255Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 35817 count 17 nextOffset 27 batches 1
2025-10-01T14:07:04.953257Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-01T14:07:04.953260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 38912 count 18 nextOffset 28 batches 1
2025-10-01T14:07:04.953264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-01T14:07:04.953267Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 42117 count 19 nextOffset 29 batches 1
2025-10-01T14:07:04.953269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-01T14:07:04.954545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 121 to 121
2025-10-01T14:07:04.953273Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 45432 count 20 nextOffset 30 batches 1
2025-10-01T14:07:04.953275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.953391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,20 HeadOffset 10 endOffset 10 curOffset 30 d0000000000_00000000000000000010_00000_0000000020_00000? size 44854 WTime 1759327624952
2025-10-01T14:07:04.954556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.954561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 121
2025-10-01T14:07:04.953415Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.953417Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.953420Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 6019 bytes (6019)
2025-10-01T14:07:04.953425Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 6019 (8388608)
2025-10-01T14:07:04.953440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953442Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-01T14:07:04.954580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 122 to 122
2025-10-01T14:07:04.953460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-01T14:07:04.953467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 3
2025-10-01T14:07:04.954582Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-9)
2025-10-01T14:07:04.954585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.954604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 122
2025-10-01T14:07:04.954604Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 5610 to budget
2025-10-01T14:07:04.953472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-01T14:07:04.954615Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 5610, ReadSizeServerDelta = 518678
2025-10-01T14:07:04.953476Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 5
2025-10-01T14:07:04.953481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 6
2025-10-01T14:07:04.953487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 7
2025-10-01T14:07:04.953492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 8
2025-10-01T14:07:04.953496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 9
2025-10-01T14:07:04.953502Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-01T14:07:04.953516Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953526Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.953536Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 20 size 44854
2025-10-01T14:07:04.953544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 32
2025-10-01T14:07:04.953553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 33
2025-10-01T14:07:04.953556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 34
2025-10-01T14:07:04.953592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 35
2025-10-01T14:07:04.953612Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 10 size 7052 endOffset 10 max time lag 0ms effective offset 1
2025-10-01T14:07:04.953624Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 5877 count 9 last offset 1, current partition end offset: 10
2025-10-01T14:07:04.953626Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-01T14:07:04.954656Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.953635Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953644Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 65 size 3383 offset: -1
2025-10-01T14:07:04.954681Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-01T14:07:04.953653Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 9 parts_count 0 source 1 size 5877 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.953656Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-01T14:07:04.954693Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (2-2)
2025-10-01T14:07:04.954698Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (3-3)
2025-10-01T14:07:04.953661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.954702Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (4-4)
2025-10-01T14:07:04.953669Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.953671Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 9 parts 0 suffix '63'
2025-10-01T14:07:04.953732Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 9 count 9 size 5857 from pos 0 cbcount 9
2025-10-01T14:07:04.953760Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:04.953834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954725Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (5-5)
2025-10-01T14:07:04.954738Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (6-6)
2025-10-01T14:07:04.953835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 66 size 3493 offset: -1
2025-10-01T14:07:04.954742Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (7-7)
2025-10-01T14:07:04.953857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954747Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (8-8)
2025-10-01T14:07:04.953862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 67 size 3603 offset: -1
2025-10-01T14:07:04.953868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 68 size 3713 offset: -1
2025-10-01T14:07:04.954759Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (9-9)
2025-10-01T14:07:04.953876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953881Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size 3823 offset: -1
2025-10-01T14:07:04.953897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.953898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.953900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953903Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.953905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.953909Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-01T14:07:04.954068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size 3933 offset: -1
2025-10-01T14:07:04.954082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.954084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.954088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-01T14:07:04.954491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954505Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.954520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.954524Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 77 size 4043 offset: -1
2025-10-01T14:07:04.954533Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.954536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.954539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 38
>>> event from dataHandler: 2025-10-01T14:07:04.954545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 39
2025-10-01T14:07:04.954587Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.954548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 40
2025-10-01T14:07:04.954674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.954550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 41
2025-10-01T14:07:04.954687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..121 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.949000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..231 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..341 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..451 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..561 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..671 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..781 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..891 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1001 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.950000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.954946Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 9, size 5049 bytes
2025-10-01T14:07:04.954692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.954698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.954960Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.954749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.954863Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.954892Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 5610 } }
2025-10-01T14:07:04.954915Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.954958Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 9e8fa27e-6a98b58e-3018f90-aaf00355
2025-10-01T14:07:04.955069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.955079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.955087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 78 size 4153 offset: -1
2025-10-01T14:07:04.955068Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.955106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.955110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 79 size 4263 offset: -1
2025-10-01T14:07:04.955116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.955118Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.955115Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.955121Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 80 size 4373 offset: -1
2025-10-01T14:07:04.955129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.955132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.955135Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size 4483 offset: -1
2025-10-01T14:07:04.955139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.955141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.955146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.955149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.955187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.955197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.955187Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955199Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.955201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.955203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.955205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.955206Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.955209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.955232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 123 to 123
2025-10-01T14:07:04.955221Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 20 size 44854 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.955244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 123
2025-10-01T14:07:04.955237Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-01T14:07:04.955240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 43
2025-10-01T14:07:04.955243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.955254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 44700 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.955260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 124 to 124
2025-10-01T14:07:04.955271Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-01T14:07:04.955276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 124
2025-10-01T14:07:04.955276Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 125 to 125
2025-10-01T14:07:04.955277Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-01T14:07:04.955279Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955282Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-01T14:07:04.955304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 125
2025-10-01T14:07:04.955284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-01T14:07:04.955289Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-01T14:07:04.955318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 126 to 126
2025-10-01T14:07:04.955294Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-01T14:07:04.955299Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-01T14:07:04.955304Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955307Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-01T14:07:04.955309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955313Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-01T14:07:04.955315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.955318Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-01T14:07:04.955320Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-01T14:07:04.955325Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-01T14:07:04.955332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955335Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-01T14:07:04.955338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955365Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955342Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-01T14:07:04.955344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955347Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-01T14:07:04.955349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955353Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-01T14:07:04.955355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955359Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-01T14:07:04.955362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955366Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-01T14:07:04.955368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955371Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-01T14:07:04.955373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.955378Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-01T14:07:04.955399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.955409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.955410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (11)
2025-10-01T14:07:04.955415Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.955427Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955428Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-01T14:07:04.955332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 126
2025-10-01T14:07:04.955460Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 3457 count 1 nextOffset 31 batches 1
2025-10-01T14:07:04.955471Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-01T14:07:04.955475Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 6992 count 2 nextOffset 32 batches 1
2025-10-01T14:07:04.955478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-01T14:07:04.955483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 10637 count 3 nextOffset 33 batches 1
2025-10-01T14:07:04.955486Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-01T14:07:04.955494Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 14392 count 4 nextOffset 34 batches 1
2025-10-01T14:07:04.955497Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-01T14:07:04.955501Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 18257 count 5 nextOffset 35 batches 1
2025-10-01T14:07:04.955504Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-01T14:07:04.955507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 127 to 127
2025-10-01T14:07:04.955507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 22232 count 6 nextOffset 36 batches 1
2025-10-01T14:07:04.955514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 127
2025-10-01T14:07:04.955511Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-01T14:07:04.955514Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 26317 count 7 nextOffset 37 batches 1
2025-10-01T14:07:04.955518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-01T14:07:04.955522Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 30512 count 8 nextOffset 38 batches 1
2025-10-01T14:07:04.955525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-01T14:07:04.955530Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 34817 count 9 nextOffset 39 batches 1
2025-10-01T14:07:04.955532Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-01T14:07:04.955536Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 39232 count 10 nextOffset 40 batches 1
2025-10-01T14:07:04.955539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-01T14:07:04.955542Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 43757 count 11 nextOffset 41 batches 1
2025-10-01T14:07:04.955545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.955529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 128 to 128
2025-10-01T14:07:04.955618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 128
2025-10-01T14:07:04.955612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,11 HeadOffset 30 endOffset 30 curOffset 41 d0000000000_00000000000000000030_00000_0000000011_00000? size 43467 WTime 1759327624955
2025-10-01T14:07:04.955468Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955509Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 129 to 129
2025-10-01T14:07:04.955660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 129
2025-10-01T14:07:04.955659Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 130 to 130
2025-10-01T14:07:04.955710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 130
2025-10-01T14:07:04.955717Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955713Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.955720Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.955722Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.955724Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 50873 bytes (50873)
2025-10-01T14:07:04.955728Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 50873 (8388608)
2025-10-01T14:07:04.955737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 11
2025-10-01T14:07:04.955744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 12
2025-10-01T14:07:04.955748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 13
2025-10-01T14:07:04.955753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 14
2025-10-01T14:07:04.955757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-01T14:07:04.955762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 16
2025-10-01T14:07:04.955767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 17
2025-10-01T14:07:04.955761Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 18
2025-10-01T14:07:04.955780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 19
2025-10-01T14:07:04.955784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 20
2025-10-01T14:07:04.955789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 21
2025-10-01T14:07:04.955797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 22
2025-10-01T14:07:04.955798Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 23
2025-10-01T14:07:04.955810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 24
2025-10-01T14:07:04.955814Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-01T14:07:04.955818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 26
2025-10-01T14:07:04.955822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 27
2025-10-01T14:07:04.955727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 131 to 131
2025-10-01T14:07:04.955826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 28
2025-10-01T14:07:04.955834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 29
2025-10-01T14:07:04.955830Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-01T14:07:04.955844Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.955848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 131
2025-10-01T14:07:04.955854Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 11 size 43467
2025-10-01T14:07:04.955905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 132 to 132
2025-10-01T14:07:04.955909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 132
2025-10-01T14:07:04.955923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 133 to 133
2025-10-01T14:07:04.955948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 133
2025-10-01T14:07:04.955967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 134 to 134
2025-10-01T14:07:04.955985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.955987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 134
2025-10-01T14:07:04.955977Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.955990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 135 to 135
2025-10-01T14:07:04.956002Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 135
2025-10-01T14:07:04.956029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 136 to 136
2025-10-01T14:07:04.956036Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956035Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 10 EndOffset 10 newEndOffset 30 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-01T14:07:04.956041Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 30
2025-10-01T14:07:04.956052Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 30, WTime# 1759327624950, sizeLag# 44854
2025-10-01T14:07:04.956054Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.956068Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 3031b506-2ec53b7c-2238ee42-59770607, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 53824, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.956079Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 53824 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 30 ClientCommitOffset 0 committedOffset 0 Guid 3031b506-2ec53b7c-2238ee42-59770607
2025-10-01T14:07:04.956092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956103Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.955979Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 20 parts 0 suffix '63' size 44854
2025-10-01T14:07:04.956050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 136
2025-10-01T14:07:04.956262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 137 to 137
2025-10-01T14:07:04.956268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 137
2025-10-01T14:07:04.956284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 138 to 138
2025-10-01T14:07:04.956295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 138
2025-10-01T14:07:04.956303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 139 to 139
2025-10-01T14:07:04.956307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 139
2025-10-01T14:07:04.956315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 140 to 140
2025-10-01T14:07:04.956320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 140
2025-10-01T14:07:04.956348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 141 to 141
2025-10-01T14:07:04.956360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 141
2025-10-01T14:07:04.956374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 142 to 142
2025-10-01T14:07:04.956385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 142
2025-10-01T14:07:04.956409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 143 to 143
2025-10-01T14:07:04.956422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 143
2025-10-01T14:07:04.956437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 144 to 144
2025-10-01T14:07:04.956448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 144
2025-10-01T14:07:04.956485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 145 to 145
2025-10-01T14:07:04.956496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 145
2025-10-01T14:07:04.956510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 146 to 146
2025-10-01T14:07:04.956520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 146
2025-10-01T14:07:04.956180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 147 to 147
2025-10-01T14:07:04.956192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956207Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 147
2025-10-01T14:07:04.956221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956230Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 87 size 4593 offset: -1
2025-10-01T14:07:04.956244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 148 to 148
2025-10-01T14:07:04.956109Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 88 size 4703 offset: -1
2025-10-01T14:07:04.956121Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956136Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 148
2025-10-01T14:07:04.956141Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956146Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956155Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956162Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956172Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956267Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 149 to 149
2025-10-01T14:07:04.956272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 44
2025-10-01T14:07:04.956279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 45
2025-10-01T14:07:04.956282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 46
2025-10-01T14:07:04.956187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956291Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 24 size 53824 endOffset 30 max time lag 0ms effective offset 10
2025-10-01T14:07:04.956302Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 44854 count 20 last offset 10, current partition end offset: 30
2025-10-01T14:07:04.956304Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-01T14:07:04.956310Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 20 parts_count 0 source 1 size 44854 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.956312Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-01T14:07:04.956319Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.956413Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 20 count 20 size 44832 from pos 0 cbcount 20
2025-10-01T14:07:04.956453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-01T14:07:04.956471Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 20 parts 0 suffix '63'
2025-10-01T14:07:04.956191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956493Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956497Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956196Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956201Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 47
2025-10-01T14:07:04.956206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 48
2025-10-01T14:07:04.956211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956223Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956528Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.956590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956619Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.956653Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.956666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956704Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.956743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 91 size 4813 offset: -1
2025-10-01T14:07:04.956766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 92 size 4923 offset: -1
2025-10-01T14:07:04.956776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 93 size 5033 offset: -1
2025-10-01T14:07:04.956789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 97 size 5143 offset: -1
2025-10-01T14:07:04.956815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 98 size 5253 offset: -1
2025-10-01T14:07:04.956843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956853Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956856Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.956870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.956874Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.956879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.956937Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 30 Result { Offset: 10 Data: "... 1183 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 1293 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 1403 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 1513 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 1623 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 1733 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 1843 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 1953 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 2063 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 1991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2173 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 2283 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 2393 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 2503 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 2613 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 2723 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 2833 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 2943 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 3053 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 2981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 3163 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 3091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 3273 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1759327624952 CreateTimestampMS: 1759327624945 UncompressedSize: 3201 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551070 RealReadOffset: 29 WaitQuotaTimeMs: 0 EndOffset: 30 StartOffset: 0 } Cookie: 10 }
2025-10-01T14:07:04.956964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 49
2025-10-01T14:07:04.956975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 50
2025-10-01T14:07:04.956631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.956988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 51
2025-10-01T14:07:04.957003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 149
2025-10-01T14:07:04.956991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 52
2025-10-01T14:07:04.956994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 53
2025-10-01T14:07:04.957030Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 30
2025-10-01T14:07:04.957041Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 30 ReadOffset 30 ReadGuid 3031b506-2ec53b7c-2238ee42-59770607 has messages 1
2025-10-01T14:07:04.957069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 150 to 150
2025-10-01T14:07:04.957081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 150
2025-10-01T14:07:04.957112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 151 to 151
2025-10-01T14:07:04.957159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 151
2025-10-01T14:07:04.957185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 152 to 152
2025-10-01T14:07:04.957072Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 3031b506-2ec53b7c-2238ee42-59770607, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 43953
2025-10-01T14:07:04.957193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957085Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 3031b506-2ec53b7c-2238ee42-59770607
2025-10-01T14:07:04.957196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 152
2025-10-01T14:07:04.957118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 153 to 153
2025-10-01T14:07:04.957256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 153
2025-10-01T14:07:04.957280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 154 to 154
2025-10-01T14:07:04.957297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 154
2025-10-01T14:07:04.957328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 155 to 155
2025-10-01T14:07:04.957337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 155
2025-10-01T14:07:04.957358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 156 to 156
2025-10-01T14:07:04.957373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 156
2025-10-01T14:07:04.957202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 101 size 5363 offset: -1
2025-10-01T14:07:04.957231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 157 to 157
2025-10-01T14:07:04.957238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 102 size 5473 offset: -1
2025-10-01T14:07:04.957246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957248Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957251Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 103 size 5583 offset: -1
2025-10-01T14:07:04.957254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.957259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.957265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957266Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 104 size 5693 offset: -1
2025-10-01T14:07:04.957275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 157
2025-10-01T14:07:04.957277Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 105 size 5803 offset: -1
2025-10-01T14:07:04.957459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 158 to 158
2025-10-01T14:07:04.957283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.957285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.957287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.957289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.957291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.957293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.957296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 158
2025-10-01T14:07:04.957302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957306Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.957308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.957311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.957503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 159 to 159
2025-10-01T14:07:04.957327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.957331Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 54
2025-10-01T14:07:04.957340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 55
2025-10-01T14:07:04.957345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 56
2025-10-01T14:07:04.957347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 57
2025-10-01T14:07:04.957519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957350Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 58
2025-10-01T14:07:04.957522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 159
2025-10-01T14:07:04.957542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 160 to 160
2025-10-01T14:07:04.957571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 160
2025-10-01T14:07:04.957605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 161 to 161
2025-10-01T14:07:04.957620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 161
2025-10-01T14:07:04.957604Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 11 size 43467 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.957622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.957638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 162 to 162
2025-10-01T14:07:04.957632Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 11 parts 0 suffix '63' size 43467
2025-10-01T14:07:04.957635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 43340 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.957650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-01T14:07:04.957658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 162
2025-10-01T14:07:04.957652Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957655Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-01T14:07:04.957657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-01T14:07:04.957662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957665Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-01T14:07:04.957667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957670Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-01T14:07:04.957680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 163 to 163
2025-10-01T14:07:04.957671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957675Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-01T14:07:04.957677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-01T14:07:04.957682Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957684Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-01T14:07:04.957695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957687Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 163
2025-10-01T14:07:04.957690Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-01T14:07:04.957691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-01T14:07:04.957696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.957699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-01T14:07:04.957723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.957712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 164 to 164
2025-10-01T14:07:04.957762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 164
2025-10-01T14:07:04.957732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.957741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (12)
2025-10-01T14:07:04.957757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-01T14:07:04.957781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 4667 count 1 nextOffset 42 batches 1
2025-10-01T14:07:04.957787Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-01T14:07:04.957798Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 9412 count 2 nextOffset 43 batches 1
2025-10-01T14:07:04.957802Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-01T14:07:04.957806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 14267 count 3 nextOffset 44 batches 1
2025-10-01T14:07:04.957809Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-01T14:07:04.957813Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 19232 count 4 nextOffset 45 batches 1
2025-10-01T14:07:04.957816Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:04.957819Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 24307 count 5 nextOffset 46 batches 1
2025-10-01T14:07:04.957828Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:04.957833Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 29492 count 6 nextOffset 47 batches 1
2025-10-01T14:07:04.957837Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:04.957850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 165 to 165
2025-10-01T14:07:04.957840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 34787 count 7 nextOffset 48 batches 1
2025-10-01T14:07:04.957844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-01T14:07:04.957848Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 40192 count 8 nextOffset 49 batches 1
2025-10-01T14:07:04.957851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-01T14:07:04.957856Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 45707 count 9 nextOffset 50 batches 1
2025-10-01T14:07:04.957865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 165
2025-10-01T14:07:04.957859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-01T14:07:04.957862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 51332 count 10 nextOffset 51 batches 1
2025-10-01T14:07:04.957865Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-01T14:07:04.957870Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 57067 count 11 nextOffset 52 batches 1
2025-10-01T14:07:04.957873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-01T14:07:04.957877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 62912 count 12 nextOffset 53 batches 1
2025-10-01T14:07:04.957879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.957958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 41,12 HeadOffset 41 endOffset 41 curOffset 53 d0000000000_00000000000000000041_00000_0000000012_00000? size 62590 WTime 1759327624957
2025-10-01T14:07:04.957999Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.958005Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.958007Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.958008Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:04.958011Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 94340 bytes (94340)
2025-10-01T14:07:04.958014Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 4, size 94340 (8388608)
2025-10-01T14:07:04.958027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 31
2025-10-01T14:07:04.958042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 32
2025-10-01T14:07:04.958052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 33
2025-10-01T14:07:04.958058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 34
2025-10-01T14:07:04.958063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-01T14:07:04.958067Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-01T14:07:04.958071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 37
2025-10-01T14:07:04.958075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 38
2025-10-01T14:07:04.958080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 39
2025-10-01T14:07:04.958093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 111 size 5913 offset: -1
2025-10-01T14:07:04.958112Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 40
2025-10-01T14:07:04.958124Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958135Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 112 size 6023 offset: -1
2025-10-01T14:07:04.958139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-01T14:07:04.958147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 113 size 6133 offset: -1
2025-10-01T14:07:04.958159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958160Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958164Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 114 size 6243 offset: -1
2025-10-01T14:07:04.958174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 115 size 6353 offset: -1
2025-10-01T14:07:04.958191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958227Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958252Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.958264Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 41 partNo 0 count 12 size 62590
2025-10-01T14:07:04.958275Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.958293Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 43953, now ReadSizeBudget = 0, ReadSizeServerDelta = 480335
2025-10-01T14:07:04.958286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.958294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958296Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.958298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.958302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.958305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 166 to 166
2025-10-01T14:07:04.958332Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 480335
2025-10-01T14:07:04.958338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.958341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 166
2025-10-01T14:07:04.958344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 59
2025-10-01T14:07:04.958357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 60
2025-10-01T14:07:04.958360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 61
2025-10-01T14:07:04.958366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 62
2025-10-01T14:07:04.958433Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-29)
2025-10-01T14:07:04.958442Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 43953 to budget
2025-10-01T14:07:04.958446Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 43953, ReadSizeServerDelta = 480335
2025-10-01T14:07:04.958448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 167 to 167
2025-10-01T14:07:04.958455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.958458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 167
2025-10-01T14:07:04.958475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 168 to 168
2025-10-01T14:07:04.958482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.958484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 168
2025-10-01T14:07:04.958489Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.958504Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-01T14:07:04.958510Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (11-11)
2025-10-01T14:07:04.958516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (12-12)
2025-10-01T14:07:04.958519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (13-13)
2025-10-01T14:07:04.958518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.958525Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (14-14)
2025-10-01T14:07:04.958528Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (15-15)
2025-10-01T14:07:04.958529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 1
2025-10-01T14:07:04.958533Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (16-16)
2025-10-01T14:07:04.958537Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (17-17)
2025-10-01T14:07:04.958548Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (18-18)
2025-10-01T14:07:04.958551Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (19-19)
2025-10-01T14:07:04.958558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 169 to 169
2025-10-01T14:07:04.958559Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (20-20)
2025-10-01T14:07:04.958563Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (21-21)
2025-10-01T14:07:04.958564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.958567Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (22-22)
2025-10-01T14:07:04.958579Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (23-23)
2025-10-01T14:07:04.958567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 169
2025-10-01T14:07:04.958582Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (24-24)
2025-10-01T14:07:04.958596Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (25-25)
2025-10-01T14:07:04.958614Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (26-26)
2025-10-01T14:07:04.958618Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (27-27)
2025-10-01T14:07:04.958621Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (28-28)
2025-10-01T14:07:04.958624Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (29-29)
2025-10-01T14:07:04.958693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 170 to 170
2025-10-01T14:07:04.958700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
>>> event from dataHandler: 2025-10-01T14:07:04.958703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 170
2025-10-01T14:07:04.958729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 171 to 171
2025-10-01T14:07:04.958390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 63
2025-10-01T14:07:04.958414Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 30 count 13 size 52160 endOffset 41 max time lag 0ms effective offset 30
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..1111 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1221 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1331 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1441 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1551 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1661 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1771 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1881 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1991 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2101 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2211 bytes.. Information: { Offset: 20 ProducerId: "src_id" SeqNo: 21 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2321 bytes.. Information: { Offset: 21 ProducerId: "src_id" SeqNo: 22 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2431 bytes.. Information: { Offset: 22 ProducerId: "src_id" SeqNo: 23 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2541 bytes.. Information: { Offset: 23 ProducerId: "src_id" SeqNo: 24 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2651 bytes.. Information: { Offset: 24 ProducerId: "src_id" SeqNo: 25 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2761 bytes.. Information: { Offset: 25 ProducerId: "src_id" SeqNo: 26 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2871 bytes.. Information: { Offset: 26 ProducerId: "src_id" SeqNo: 27 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2981 bytes.. Information: { Offset: 27 ProducerId: "src_id" SeqNo: 28 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3091 bytes.. Information: { Offset: 28 ProducerId: "src_id" SeqNo: 29 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3201 bytes.. Information: { Offset: 29 ProducerId: "src_id" SeqNo: 30 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.952000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.958737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.958780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 171
2025-10-01T14:07:04.958799Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 20, size 43120 bytes
2025-10-01T14:07:04.958805Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.958446Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 43467 count 11 last offset 30, current partition end offset: 41
2025-10-01T14:07:04.958448Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-01T14:07:04.958456Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 11 parts_count 0 source 1 size 43467 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.958459Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-01T14:07:04.958466Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.958511Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 11 parts 0 suffix '63'
2025-10-01T14:07:04.958532Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 11 count 11 size 43445 from pos 0 cbcount 11
2025-10-01T14:07:04.958559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 30
2025-10-01T14:07:04.958859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 172 to 172
2025-10-01T14:07:04.957131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957136Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 172
2025-10-01T14:07:04.957139Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957143Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.957200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.958894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 173 to 173
2025-10-01T14:07:04.957222Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957251Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.958903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 173
2025-10-01T14:07:04.957482Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.957499Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957511Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957524Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.957690Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 174 to 174
2025-10-01T14:07:04.957696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957761Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 30 EndOffset 30 newEndOffset 41 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-01T14:07:04.958925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.957764Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 30 endOffset 41
2025-10-01T14:07:04.958939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 174
2025-10-01T14:07:04.957780Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 30, endOffset# 41, WTime# 1759327624952, sizeLag# 43467
2025-10-01T14:07:04.957782Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.957791Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# c64c7f9f-b5a1c3a9-18756348-35c82f20, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 52160, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.957799Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.957816Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957824Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 52160 maxTimeLagMs 0 readTimestampMs 0 readOffset 30 EndOffset 41 ClientCommitOffset 0 committedOffset 0 Guid c64c7f9f-b5a1c3a9-18756348-35c82f20
2025-10-01T14:07:04.957854Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.957878Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.957891Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958013Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958070Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958115Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958141Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958163Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958175Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958188Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958192Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958575Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.958581Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958602Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.958686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.958692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.958697Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.958702Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.958707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.958874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 121 size 6463 offset: -1
2025-10-01T14:07:04.958911Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 122 size 6573 offset: -1
2025-10-01T14:07:04.958926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 123 size 6683 offset: -1
2025-10-01T14:07:04.958942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 124 size 6793 offset: -1
2025-10-01T14:07:04.958955Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 125 size 6903 offset: -1
2025-10-01T14:07:04.958966Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.958989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.958993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.958995Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.958999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959138Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 41 Result { Offset: 30 Data: "... 3383 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 3493 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 3603 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 3713 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 3823 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 3933 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 36 Data: "... 4043 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 3971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 4153 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 4081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 4263 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 4191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 4373 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 4301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 4483 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1759327624955 CreateTimestampMS: 1759327624945 UncompressedSize: 4411 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551358 RealReadOffset: 40 WaitQuotaTimeMs: 0 EndOffset: 41 StartOffset: 0 } Cookie: 30 }
2025-10-01T14:07:04.959010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959022Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 175 to 175
2025-10-01T14:07:04.959037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 64
2025-10-01T14:07:04.959043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 65
2025-10-01T14:07:04.959046Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 66
2025-10-01T14:07:04.959049Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 67
2025-10-01T14:07:04.959215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 68
2025-10-01T14:07:04.959230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 175
2025-10-01T14:07:04.959283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 176 to 176
2025-10-01T14:07:04.959289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 176
2025-10-01T14:07:04.959189Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 41
2025-10-01T14:07:04.959199Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 41 ReadOffset 41 ReadGuid c64c7f9f-b5a1c3a9-18756348-35c82f20 has messages 1
2025-10-01T14:07:04.959229Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959256Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 43953 } }
2025-10-01T14:07:04.959275Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# c64c7f9f-b5a1c3a9-18756348-35c82f20, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 42989
2025-10-01T14:07:04.959282Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# c64c7f9f-b5a1c3a9-18756348-35c82f20
2025-10-01T14:07:04.959351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 177 to 177
2025-10-01T14:07:04.959356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 177
2025-10-01T14:07:04.959347Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 178 to 178
2025-10-01T14:07:04.959347Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.959366Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 1e6c771e-4bdeb5f5-eb2d8217-d550cfa0
2025-10-01T14:07:04.959396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 178
2025-10-01T14:07:04.959428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 179 to 179
2025-10-01T14:07:04.959453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 179
2025-10-01T14:07:04.959473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 180 to 180
2025-10-01T14:07:04.959491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959490Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 42989, now ReadSizeBudget = 0, ReadSizeServerDelta = 481299
2025-10-01T14:07:04.959493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 180
2025-10-01T14:07:04.959514Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 481299
2025-10-01T14:07:04.959525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 181 to 181
2025-10-01T14:07:04.959546Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (30-40)
2025-10-01T14:07:04.959552Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 42989 to budget
2025-10-01T14:07:04.959553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959555Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 42989, ReadSizeServerDelta = 481299
2025-10-01T14:07:04.959556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 181
2025-10-01T14:07:04.959573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 182 to 182
2025-10-01T14:07:04.959593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 182
2025-10-01T14:07:04.959602Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.959612Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (30-30)
2025-10-01T14:07:04.959615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.959633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 2
2025-10-01T14:07:04.959618Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (31-31)
2025-10-01T14:07:04.959642Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (32-32)
2025-10-01T14:07:04.959645Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (33-33)
2025-10-01T14:07:04.959654Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (34-34)
2025-10-01T14:07:04.959655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 183 to 183
2025-10-01T14:07:04.959657Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (35-35)
2025-10-01T14:07:04.959421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959660Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (36-36)
2025-10-01T14:07:04.959435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959663Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (37-37)
2025-10-01T14:07:04.959438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959442Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959675Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (38-38)
2025-10-01T14:07:04.959676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 183
2025-10-01T14:07:04.959446Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959678Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (39-39)
2025-10-01T14:07:04.959450Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959532Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.959681Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (40-40)
2025-10-01T14:07:04.959696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 184 to 184
2025-10-01T14:07:04.959539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.959544Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.959712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959564Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.959567Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 184
>>> event from dataHandler: 2025-10-01T14:07:04.959592Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.959601Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959663Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 185 to 185
2025-10-01T14:07:04.959728Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959757Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..3311 bytes.. Information: { Offset: 30 ProducerId: "src_id" SeqNo: 31 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3421 bytes.. Information: { Offset: 31 ProducerId: "src_id" SeqNo: 32 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3531 bytes.. Information: { Offset: 32 ProducerId: "src_id" SeqNo: 33 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3641 bytes.. Information: { Offset: 33 ProducerId: "src_id" SeqNo: 34 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3751 bytes.. Information: { Offset: 34 ProducerId: "src_id" SeqNo: 35 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3861 bytes.. Information: { Offset: 35 ProducerId: "src_id" SeqNo: 36 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3971 bytes.. Information: { Offset: 36 ProducerId: "src_id" SeqNo: 37 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4081 bytes.. Information: { Offset: 37 ProducerId: "src_id" SeqNo: 38 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4191 bytes.. Information: { Offset: 38 ProducerId: "src_id" SeqNo: 39 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4301 bytes.. Information: { Offset: 39 ProducerId: "src_id" SeqNo: 40 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4411 bytes.. Information: { Offset: 40 ProducerId: "src_id" SeqNo: 41 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.955000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.959776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 185
2025-10-01T14:07:04.959793Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 11, size 42471 bytes
2025-10-01T14:07:04.959797Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.959791Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959823Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959904Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959912Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.959943Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959979Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960013Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960033Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 186 to 186
2025-10-01T14:07:04.960073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 186
2025-10-01T14:07:04.960074Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960109Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 187 to 187
2025-10-01T14:07:04.960138Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 187
2025-10-01T14:07:04.960179Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 188 to 188
2025-10-01T14:07:04.960211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 188
2025-10-01T14:07:04.960268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 189 to 189
2025-10-01T14:07:04.960264Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 189
2025-10-01T14:07:04.960312Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 131 size 7013 offset: -1
2025-10-01T14:07:04.960342Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959614Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 132 size 7123 offset: -1
2025-10-01T14:07:04.959631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 133 size 7233 offset: -1
2025-10-01T14:07:04.959668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960368Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 134 size 7343 offset: -1
2025-10-01T14:07:04.959682Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959683Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959687Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 135 size 7453 offset: -1
2025-10-01T14:07:04.960409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 190 to 190
2025-10-01T14:07:04.959702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.959720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 190
2025-10-01T14:07:04.959722Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959726Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.959736Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.959744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960442Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959746Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959750Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.959758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.959775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 69
2025-10-01T14:07:04.959786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 70
2025-10-01T14:07:04.959789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 71
2025-10-01T14:07:04.960471Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.959792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 72
2025-10-01T14:07:04.959795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 73
2025-10-01T14:07:04.960371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 191 to 191
2025-10-01T14:07:04.960385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 141 size 7563 offset: -1
2025-10-01T14:07:04.960398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 191
2025-10-01T14:07:04.960405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 142 size 7673 offset: -1
2025-10-01T14:07:04.960415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 143 size 7783 offset: -1
2025-10-01T14:07:04.960430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960498Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 144 size 7893 offset: -1
2025-10-01T14:07:04.960448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 145 size 8003 offset: -1
2025-10-01T14:07:04.960459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.960500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.960540Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.960546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.960548Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.960551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.960565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 3
2025-10-01T14:07:04.960564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.960571Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.960574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.960576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.960578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.960580Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.960582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.960590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 192 to 192
2025-10-01T14:07:04.960595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 192
2025-10-01T14:07:04.960597Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 41 count 12 size 62590 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.960585Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 74
2025-10-01T14:07:04.960640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 75
2025-10-01T14:07:04.960643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 76
2025-10-01T14:07:04.960646Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 77
2025-10-01T14:07:04.960649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 78
2025-10-01T14:07:04.960667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 193 to 193
2025-10-01T14:07:04.960653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.960657Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 12 parts 0 suffix '63' size 62590
2025-10-01T14:07:04.960672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960663Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 62460 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.960675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 193
2025-10-01T14:07:04.960668Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-01T14:07:04.960677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960680Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-01T14:07:04.960682Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960685Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-01T14:07:04.960687Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960690Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-01T14:07:04.960692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-01T14:07:04.960697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-01T14:07:04.960702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960704Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-01T14:07:04.960706Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960710Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-01T14:07:04.960711Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960714Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-01T14:07:04.960716Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-01T14:07:04.960721Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960725Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-01T14:07:04.960727Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.960730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-01T14:07:04.960755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.960766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.960768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-01T14:07:04.960781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-01T14:07:04.960788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 194 to 194
2025-10-01T14:07:04.960799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 194
2025-10-01T14:07:04.960812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 5987 count 1 nextOffset 54 batches 1
2025-10-01T14:07:04.960822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-01T14:07:04.960837Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 12052 count 2 nextOffset 55 batches 1
2025-10-01T14:07:04.960841Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-01T14:07:04.960878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 195 to 195
2025-10-01T14:07:04.960845Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 18227 count 3 nextOffset 56 batches 1
2025-10-01T14:07:04.960885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 195
2025-10-01T14:07:04.960847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-01T14:07:04.960850Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 24512 count 4 nextOffset 57 batches 1
2025-10-01T14:07:04.960853Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-01T14:07:04.960856Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 30907 count 5 nextOffset 58 batches 1
2025-10-01T14:07:04.960860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-01T14:07:04.960863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 37412 count 6 nextOffset 59 batches 1
2025-10-01T14:07:04.960866Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-01T14:07:04.960869Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 44027 count 7 nextOffset 60 batches 1
2025-10-01T14:07:04.960872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-01T14:07:04.960886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 50752 count 8 nextOffset 61 batches 1
2025-10-01T14:07:04.960888Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-01T14:07:04.960893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 57587 count 9 nextOffset 62 batches 1
2025-10-01T14:07:04.960895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-01T14:07:04.960898Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 64532 count 10 nextOffset 63 batches 1
2025-10-01T14:07:04.960901Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-01T14:07:04.960904Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 71587 count 11 nextOffset 64 batches 1
2025-10-01T14:07:04.960907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-01T14:07:04.960910Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 78752 count 12 nextOffset 65 batches 1
2025-10-01T14:07:04.960913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-01T14:07:04.960917Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 86027 count 13 nextOffset 66 batches 1
2025-10-01T14:07:04.960651Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.960920Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-01T14:07:04.960696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.960924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 93412 count 14 nextOffset 67 batches 1
2025-10-01T14:07:04.960926Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-01T14:07:04.960930Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 100907 count 15 nextOffset 68 batches 1
2025-10-01T14:07:04.960967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 196 to 196
2025-10-01T14:07:04.960934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-01T14:07:04.960716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.960974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.960977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 196
2025-10-01T14:07:04.960720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.960937Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 108512 count 16 nextOffset 69 batches 1
2025-10-01T14:07:04.960724Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.960747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.960780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960794Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960799Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960814Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.960939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-01T14:07:04.960818Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 41 EndOffset 41 newEndOffset 53 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-01T14:07:04.960944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 116227 count 17 nextOffset 70 batches 1
2025-10-01T14:07:04.960822Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 41 endOffset 53
2025-10-01T14:07:04.960947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-01T14:07:04.960841Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 41, endOffset# 53, WTime# 1759327624955, sizeLag# 62590
2025-10-01T14:07:04.960951Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 124052 count 18 nextOffset 71 batches 1
2025-10-01T14:07:04.960844Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.960954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-01T14:07:04.960863Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 9fd064c3-c2367adf-8157328b-8608b97d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 14, size# 75108, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.960958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 131987 count 19 nextOffset 72 batches 1
2025-10-01T14:07:04.960881Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 14 maxSize 75108 maxTimeLagMs 0 readTimestampMs 0 readOffset 41 EndOffset 53 ClientCommitOffset 0 committedOffset 0 Guid 9fd064c3-c2367adf-8157328b-8608b97d
2025-10-01T14:07:04.960961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-01T14:07:04.960964Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 53 PartNo 0 PackedSize 140032 count 20 nextOffset 73 batches 1
2025-10-01T14:07:04.960966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.961029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 197 to 197
2025-10-01T14:07:04.961035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 197
2025-10-01T14:07:04.961056Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 198 to 198
2025-10-01T14:07:04.961115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 198
2025-10-01T14:07:04.961164Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 199 to 199
2025-10-01T14:07:04.961189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 199
2025-10-01T14:07:04.961234Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.961262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 4
2025-10-01T14:07:04.961266Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 53,20 HeadOffset 53 endOffset 53 curOffset 73 d0000000000_00000000000000000053_00000_0000000020_00000? size 139454 WTime 1759327624961
2025-10-01T14:07:04.961283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 200 to 200
2025-10-01T14:07:04.961290Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 200
2025-10-01T14:07:04.961335Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961375Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 201 to 201
2025-10-01T14:07:04.961408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 201
2025-10-01T14:07:04.961399Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.961406Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.961408Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.961410Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:04.961411Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:04.961414Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 5 keys were taken away. Let's read 156930 bytes (156930)
2025-10-01T14:07:04.961416Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 202 to 202
2025-10-01T14:07:04.961440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 202
2025-10-01T14:07:04.961417Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 5, size 156930 (8388608)
2025-10-01T14:07:04.961429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 42
2025-10-01T14:07:04.961440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 43
2025-10-01T14:07:04.961445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 44
2025-10-01T14:07:04.961449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 45
2025-10-01T14:07:04.961453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 46
2025-10-01T14:07:04.961458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 47
2025-10-01T14:07:04.961469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 203 to 203
2025-10-01T14:07:04.961462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 48
2025-10-01T14:07:04.961466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 49
2025-10-01T14:07:04.961470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 50
2025-10-01T14:07:04.961477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 51
2025-10-01T14:07:04.961480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 203
2025-10-01T14:07:04.961480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 52
2025-10-01T14:07:04.961484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 53
2025-10-01T14:07:04.961507Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961452Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 204 to 204
2025-10-01T14:07:04.961511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961524Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 151 size 8113 offset: -1
2025-10-01T14:07:04.961530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 204
2025-10-01T14:07:04.961535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 152 size 8223 offset: -1
2025-10-01T14:07:04.961555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 205 to 205
2025-10-01T14:07:04.961565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961557Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 205
2025-10-01T14:07:04.961563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961568Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 153 size 8333 offset: -1
2025-10-01T14:07:04.961583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 206 to 206
2025-10-01T14:07:04.961583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961592Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 154 size 8443 offset: -1
2025-10-01T14:07:04.961605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961597Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961606Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961602Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 155 size 8553 offset: -1
2025-10-01T14:07:04.961607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961613Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961619Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 206
2025-10-01T14:07:04.961626Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961634Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961638Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 207 to 207
2025-10-01T14:07:04.961644Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961653Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.961675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.961678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 207
2025-10-01T14:07:04.961664Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.961674Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 53 partNo 0 count 20 size 139454
2025-10-01T14:07:04.961680Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.961686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.961697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 208 to 208
2025-10-01T14:07:04.961693Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.961696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.961698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.961700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.961702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.961704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.961706Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.961708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.961722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 208
2025-10-01T14:07:04.961743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 79
2025-10-01T14:07:04.961756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 209 to 209
2025-10-01T14:07:04.961758Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 80
2025-10-01T14:07:04.961760Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 81
2025-10-01T14:07:04.961763Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 82
2025-10-01T14:07:04.961765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 83
2025-10-01T14:07:04.961773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 209
2025-10-01T14:07:04.961800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 210 to 210
2025-10-01T14:07:04.961787Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 41 count 14 size 75108 endOffset 53 max time lag 0ms effective offset 41
2025-10-01T14:07:04.961804Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 62590 count 12 last offset 41, current partition end offset: 53
2025-10-01T14:07:04.961806Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-01T14:07:04.961813Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 41 partno 0 count 12 parts_count 0 source 1 size 62590 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.961816Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-01T14:07:04.961820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 210
2025-10-01T14:07:04.961823Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.961826Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 12 parts 0 suffix '63'
2025-10-01T14:07:04.961812Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.961862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 211 to 211
2025-10-01T14:07:04.961876Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 41 totakecount 12 count 12 size 62568 from pos 0 cbcount 12
2025-10-01T14:07:04.961887Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961905Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 211
2025-10-01T14:07:04.961909Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961911Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 41
2025-10-01T14:07:04.961917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.961931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 212 to 212
2025-10-01T14:07:04.961954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.961957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 212
2025-10-01T14:07:04.961981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 213 to 213
2025-10-01T14:07:04.961973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 213
2025-10-01T14:07:04.961983Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.961988Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.961992Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.961997Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 214 to 214
2025-10-01T14:07:04.962104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 214
2025-10-01T14:07:04.962136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 215 to 215
2025-10-01T14:07:04.962154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 215
2025-10-01T14:07:04.962182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 216 to 216
2025-10-01T14:07:04.962217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 216
2025-10-01T14:07:04.962242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.962253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 5
2025-10-01T14:07:04.962282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 217 to 217
2025-10-01T14:07:04.962300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 217
2025-10-01T14:07:04.962204Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.962324Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 53 Result { Offset: 41 Data: "... 4593 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 4521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 4703 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 4631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 4813 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 4741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 4923 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 4851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 5033 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 4961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 5143 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 5071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 5253 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 5181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 5363 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624945 UncompressedSize: 5291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 5473 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624947 UncompressedSize: 5401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 5583 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624947 UncompressedSize: 5511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 5693 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624947 UncompressedSize: 5621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 5803 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1759327624957 CreateTimestampMS: 1759327624947 UncompressedSize: 5731 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551326 RealReadOffset: 52 WaitQuotaTimeMs: 0 EndOffset: 53 StartOffset: 0 } Cookie: 41 }
2025-10-01T14:07:04.962421Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 53
2025-10-01T14:07:04.962433Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 53 ReadOffset 53 ReadGuid 9fd064c3-c2367adf-8157328b-8608b97d has messages 1
2025-10-01T14:07:04.962470Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 9fd064c3-c2367adf-8157328b-8608b97d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 62065
2025-10-01T14:07:04.962477Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 9fd064c3-c2367adf-8157328b-8608b97d
2025-10-01T14:07:04.962302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 161 size 8663 offset: -1
2025-10-01T14:07:04.962339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 162 size 8773 offset: -1
2025-10-01T14:07:04.962355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 163 size 8883 offset: -1
2025-10-01T14:07:04.962368Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 164 size 8993 offset: -1
2025-10-01T14:07:04.962396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 165 size 9103 offset: -1
2025-10-01T14:07:04.962406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962595Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.962622Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.962633Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.962418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962641Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.962419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.962424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.962431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962436Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.962442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.962444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.962447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.962449Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.962460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.962462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.962465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.962467Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.962469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.962481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 84
2025-10-01T14:07:04.962492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 85
2025-10-01T14:07:04.962496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 86
2025-10-01T14:07:04.962498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 87
2025-10-01T14:07:04.962501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 88
2025-10-01T14:07:04.962716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962729Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 218 to 218
2025-10-01T14:07:04.962733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962742Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962746Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.962750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 218
2025-10-01T14:07:04.962781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 219 to 219
2025-10-01T14:07:04.962787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 219
2025-10-01T14:07:04.962812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 220 to 220
2025-10-01T14:07:04.962819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 220
2025-10-01T14:07:04.962842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 221 to 221
2025-10-01T14:07:04.962848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 221
2025-10-01T14:07:04.962878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 222 to 222
2025-10-01T14:07:04.962884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 222
2025-10-01T14:07:04.962913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 223 to 223
2025-10-01T14:07:04.962919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 223
2025-10-01T14:07:04.962940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 224 to 224
2025-10-01T14:07:04.962952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 224
2025-10-01T14:07:04.962981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 225 to 225
2025-10-01T14:07:04.962986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.962989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 225
2025-10-01T14:07:04.962976Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.962986Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.962997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 171 size 9213 offset: -1
2025-10-01T14:07:04.963012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 226 to 226
2025-10-01T14:07:04.963007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 172 size 9323 offset: -1
2025-10-01T14:07:04.963030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963035Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 62065, now ReadSizeBudget = 0, ReadSizeServerDelta = 462223
2025-10-01T14:07:04.963031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 173 size 9433 offset: -1
2025-10-01T14:07:04.963046Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963047Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963061Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 462223
2025-10-01T14:07:04.963117Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (41-52)
2025-10-01T14:07:04.963129Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 62065 to budget
2025-10-01T14:07:04.963133Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 62065, ReadSizeServerDelta = 462223
2025-10-01T14:07:04.962781Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.962871Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.962902Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 42989 } }
2025-10-01T14:07:04.962915Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 7dc03d29-4aebddc8-4f5fb0cd-7aeb3e22
2025-10-01T14:07:04.962923Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963023Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963086Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963119Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963159Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963203Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.963051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 174 size 9543 offset: -1
2025-10-01T14:07:04.963216Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (41-41)
2025-10-01T14:07:04.963222Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (42-42)
2025-10-01T14:07:04.963061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 175 size 9653 offset: -1
2025-10-01T14:07:04.963082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963248Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (43-43)
2025-10-01T14:07:04.963091Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963251Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (44-44)
2025-10-01T14:07:04.963093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963094Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963273Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (45-45)
2025-10-01T14:07:04.963278Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (46-46)
2025-10-01T14:07:04.963220Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963289Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (47-47)
2025-10-01T14:07:04.963293Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (48-48)
2025-10-01T14:07:04.963326Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (49-49)
2025-10-01T14:07:04.963339Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (50-50)
2025-10-01T14:07:04.963325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963347Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (51-51)
2025-10-01T14:07:04.963335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963353Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (52-52)
2025-10-01T14:07:04.963352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963370Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963382Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 89
2025-10-01T14:07:04.963407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 90
2025-10-01T14:07:04.963410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 91
2025-10-01T14:07:04.963412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 92
2025-10-01T14:07:04.963415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 93
>>> event from dataHandler: 2025-10-01T14:07:04.963310Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963388Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.963457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..4521 bytes.. Information: { Offset: 41 ProducerId: "src_id" SeqNo: 42 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4631 bytes.. Information: { Offset: 42 ProducerId: "src_id" SeqNo: 43 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4741 bytes.. Information: { Offset: 43 ProducerId: "src_id" SeqNo: 44 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4851 bytes.. Information: { Offset: 44 ProducerId: "src_id" SeqNo: 45 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4961 bytes.. Information: { Offset: 45 ProducerId: "src_id" SeqNo: 46 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5071 bytes.. Information: { Offset: 46 ProducerId: "src_id" SeqNo: 47 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5181 bytes.. Information: { Offset: 47 ProducerId: "src_id" SeqNo: 48 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5291 bytes.. Information: { Offset: 48 ProducerId: "src_id" SeqNo: 49 CreateTime: 2025-10-01T14:07:04.945000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5401 bytes.. Information: { Offset: 49 ProducerId: "src_id" SeqNo: 50 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5511 bytes.. Information: { Offset: 50 ProducerId: "src_id" SeqNo: 51 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5621 bytes.. Information: { Offset: 51 ProducerId: "src_id" SeqNo: 52 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5731 bytes.. Information: { Offset: 52 ProducerId: "src_id" SeqNo: 53 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.957000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.963485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.963503Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 12, size 61512 bytes
2025-10-01T14:07:04.963508Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.963499Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.963513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.963524Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.963062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 226
2025-10-01T14:07:04.963556Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.963621Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.963655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 227 to 227
2025-10-01T14:07:04.963686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 227
2025-10-01T14:07:04.963711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 228 to 228
2025-10-01T14:07:04.963733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 228
2025-10-01T14:07:04.963764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 229 to 229
2025-10-01T14:07:04.963784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 229
2025-10-01T14:07:04.963813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 230 to 230
2025-10-01T14:07:04.963834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 230
2025-10-01T14:07:04.963868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 231 to 231
2025-10-01T14:07:04.963668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.963689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.963703Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.963897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 231
2025-10-01T14:07:04.963688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 181 size 9763 offset: -1
2025-10-01T14:07:04.963725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 182 size 9873 offset: -1
2025-10-01T14:07:04.963751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963756Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 183 size 9983 offset: -1
2025-10-01T14:07:04.963761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 232 to 232
2025-10-01T14:07:04.963763Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 185 size 10093 offset: -1
2025-10-01T14:07:04.963808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 186 size 10203 offset: -1
2025-10-01T14:07:04.963818Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 232
2025-10-01T14:07:04.963837Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 233 to 233
2025-10-01T14:07:04.964016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 233
2025-10-01T14:07:04.964041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 234 to 234
2025-10-01T14:07:04.964063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.963973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.964066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 234
2025-10-01T14:07:04.963978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.963986Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.963989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.963996Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.963998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.964001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.964005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.964006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.964008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.964016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 94
2025-10-01T14:07:04.964029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 95
2025-10-01T14:07:04.964095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 235 to 235
2025-10-01T14:07:04.964154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 235
2025-10-01T14:07:04.964188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 236 to 236
2025-10-01T14:07:04.964185Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 62065 } }
2025-10-01T14:07:04.964212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 236
2025-10-01T14:07:04.964242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 237 to 237
2025-10-01T14:07:04.964031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 96
2025-10-01T14:07:04.964265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 237
2025-10-01T14:07:04.964033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 97
2025-10-01T14:07:04.964036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 98
2025-10-01T14:07:04.964243Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 2e21567f-2fbac653-f26d3e20-f0f9fdc
2025-10-01T14:07:04.964310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 238 to 238
2025-10-01T14:07:04.964333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 238
2025-10-01T14:07:04.964366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 239 to 239
2025-10-01T14:07:04.964376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 239
2025-10-01T14:07:04.964401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 240 to 240
2025-10-01T14:07:04.964401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.964433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 240
2025-10-01T14:07:04.964427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.964439Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.964449Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.964462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 241 to 241
2025-10-01T14:07:04.964454Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.964488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 241
2025-10-01T14:07:04.964515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 242 to 242
2025-10-01T14:07:04.964546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.964537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.964548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 242
2025-10-01T14:07:04.964550Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.964561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.964566Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.964577Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.964733Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.964809Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 191 size 10313 offset: -1
2025-10-01T14:07:04.965139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 192 size 10423 offset: -1
2025-10-01T14:07:04.965166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965168Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 193 size 10533 offset: -1
2025-10-01T14:07:04.964948Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965012Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965051Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965085Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965133Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965161Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 194 size 10643 offset: -1
2025-10-01T14:07:04.965208Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 195 size 10753 offset: -1
2025-10-01T14:07:04.965219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965228Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965248Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965253Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965263Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965239Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965277Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 99
2025-10-01T14:07:04.965304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 100
2025-10-01T14:07:04.965307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 101
2025-10-01T14:07:04.965310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 102
2025-10-01T14:07:04.965313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 200  requestId: <none> cookie: 103
2025-10-01T14:07:04.965327Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965395Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965473Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965535Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965570Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965604Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965636Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.965654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 243 to 243
2025-10-01T14:07:04.965654Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.965668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 243
2025-10-01T14:07:04.965663Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.965668Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.965676Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.965742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 244 to 244
2025-10-01T14:07:04.965748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 244
2025-10-01T14:07:04.965777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 245 to 245
2025-10-01T14:07:04.965783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 245
2025-10-01T14:07:04.965769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.965789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.965795Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.965802Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.965809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 246 to 246
2025-10-01T14:07:04.965807Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.965816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 246
2025-10-01T14:07:04.965846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 247 to 247
2025-10-01T14:07:04.965853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 247
2025-10-01T14:07:04.965881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 248 to 248
2025-10-01T14:07:04.965902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 248
2025-10-01T14:07:04.965939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 249 to 249
2025-10-01T14:07:04.965959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 249
2025-10-01T14:07:04.965985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 250 to 250
2025-10-01T14:07:04.966015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 250
2025-10-01T14:07:04.965813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 201 size 10863 offset: -1
2025-10-01T14:07:04.965836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 202 size 10973 offset: -1
2025-10-01T14:07:04.965849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 101 partNo : 0 messageNo: 203 size 11083 offset: -1
2025-10-01T14:07:04.966052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 251 to 251
2025-10-01T14:07:04.966077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 251
2025-10-01T14:07:04.966102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 252 to 252
2025-10-01T14:07:04.966127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 252
2025-10-01T14:07:04.966165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 253 to 253
2025-10-01T14:07:04.966188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 253
2025-10-01T14:07:04.965864Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 102 partNo : 0 messageNo: 204 size 11193 offset: -1
2025-10-01T14:07:04.965886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965891Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 103 partNo : 0 messageNo: 205 size 11303 offset: -1
2025-10-01T14:07:04.965895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 254 to 254
2025-10-01T14:07:04.965948Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966010Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966022Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 254
2025-10-01T14:07:04.966026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966054Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966058Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966084Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966114Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966125Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966134Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966234Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 255 to 255
2025-10-01T14:07:04.966301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 255
2025-10-01T14:07:04.966300Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 256 to 256
2025-10-01T14:07:04.966351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966344Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 256
2025-10-01T14:07:04.966399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 257 to 257
2025-10-01T14:07:04.965901Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965925Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.965928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 257
2025-10-01T14:07:04.965932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966422Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.965940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.965951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.965954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.965956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.965965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 206  requestId: <none> cookie: 104
2025-10-01T14:07:04.966457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 258 to 258
2025-10-01T14:07:04.965976Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 207  requestId: <none> cookie: 105
2025-10-01T14:07:04.965979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 208  requestId: <none> cookie: 106
2025-10-01T14:07:04.965981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 209  requestId: <none> cookie: 107
2025-10-01T14:07:04.965984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 210  requestId: <none> cookie: 108
2025-10-01T14:07:04.966237Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 104 partNo : 0 messageNo: 211 size 11413 offset: -1
2025-10-01T14:07:04.966254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966256Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966259Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 105 partNo : 0 messageNo: 212 size 11523 offset: -1
2025-10-01T14:07:04.966288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966474Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966290Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 106 partNo : 0 messageNo: 213 size 11633 offset: -1
2025-10-01T14:07:04.966321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 107 partNo : 0 messageNo: 214 size 11743 offset: -1
2025-10-01T14:07:04.966497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 258
2025-10-01T14:07:04.966342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 108 partNo : 0 messageNo: 215 size 11853 offset: -1
2025-10-01T14:07:04.966352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 259 to 259
2025-10-01T14:07:04.966527Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 259
2025-10-01T14:07:04.966572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 260 to 260
2025-10-01T14:07:04.966563Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 260
2025-10-01T14:07:04.966607Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966543Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 261 to 261
2025-10-01T14:07:04.966550Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966554Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966563Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 216  requestId: <none> cookie: 109
2025-10-01T14:07:04.966585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 217  requestId: <none> cookie: 110
2025-10-01T14:07:04.966589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 218  requestId: <none> cookie: 111
2025-10-01T14:07:04.966662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 261
2025-10-01T14:07:04.966591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 219  requestId: <none> cookie: 112
2025-10-01T14:07:04.966594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 220  requestId: <none> cookie: 113
2025-10-01T14:07:04.966733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 262 to 262
2025-10-01T14:07:04.966647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966662Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.966754Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 262
2025-10-01T14:07:04.966766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 263 to 263
2025-10-01T14:07:04.966791Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966794Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.966815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 263
2025-10-01T14:07:04.966840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 264 to 264
2025-10-01T14:07:04.966865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 264
2025-10-01T14:07:04.966868Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 265 to 265
2025-10-01T14:07:04.966925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966917Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 265
2025-10-01T14:07:04.966960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 266 to 266
2025-10-01T14:07:04.966962Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.966989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 266
2025-10-01T14:07:04.967017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 267 to 267
2025-10-01T14:07:04.966825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.967052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 267
2025-10-01T14:07:04.966835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 109 partNo : 0 messageNo: 221 size 11963 offset: -1
2025-10-01T14:07:04.966851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 268 to 268
2025-10-01T14:07:04.966852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 110 partNo : 0 messageNo: 222 size 12073 offset: -1
2025-10-01T14:07:04.966879Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 111 partNo : 0 messageNo: 223 size 12183 offset: -1
2025-10-01T14:07:04.966897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 112 partNo : 0 messageNo: 224 size 12293 offset: -1
2025-10-01T14:07:04.966925Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.966930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 113 partNo : 0 messageNo: 225 size 12403 offset: -1
2025-10-01T14:07:04.967115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 268
2025-10-01T14:07:04.966933Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 269 to 269
2025-10-01T14:07:04.967166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.967168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 269
2025-10-01T14:07:04.966960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.966975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.966977Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.966981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.966983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.967194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 270 to 270
2025-10-01T14:07:04.966992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 226  requestId: <none> cookie: 114
2025-10-01T14:07:04.967001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 227  requestId: <none> cookie: 115
2025-10-01T14:07:04.967004Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 228  requestId: <none> cookie: 116
2025-10-01T14:07:04.967007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 229  requestId: <none> cookie: 117
2025-10-01T14:07:04.967009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 230  requestId: <none> cookie: 118
2025-10-01T14:07:04.967180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 114 partNo : 0 messageNo: 231 size 12513 offset: -1
2025-10-01T14:07:04.967205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.967214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.967218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.967255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 270
2025-10-01T14:07:04.967289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 271 to 271
2025-10-01T14:07:04.967320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.967322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 271
2025-10-01T14:07:04.967348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 272 to 272
2025-10-01T14:07:04.967040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967059Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967253Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 115 partNo : 0 messageNo: 232 size 12623 offset: -1
2025-10-01T14:07:04.967275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.967279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 116 partNo : 0 messageNo: 233 size 12733 offset: -1
2025-10-01T14:07:04.967292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 272
2025-10-01T14:07:04.967293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 117 partNo : 0 messageNo: 234 size 12843 offset: -1
2025-10-01T14:07:04.967310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967312Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 118 partNo : 0 messageNo: 235 size 12953 offset: -1
2025-10-01T14:07:04.967318Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.967322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.967324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.967326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.967328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.967331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.967333Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.967336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.967216Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967279Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967306Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967442Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967497Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967502Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967533Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967505Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.967507Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.967518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 236  requestId: <none> cookie: 119
2025-10-01T14:07:04.967529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 237  requestId: <none> cookie: 120
2025-10-01T14:07:04.967531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 238  requestId: <none> cookie: 121
2025-10-01T14:07:04.967535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 239  requestId: <none> cookie: 122
2025-10-01T14:07:04.967537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 240  requestId: <none> cookie: 123
2025-10-01T14:07:04.967603Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967619Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967623Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.967713Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967724Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967732Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.967852Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967915Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967950Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.967994Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968042Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 273 to 273
2025-10-01T14:07:04.968110Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 273
2025-10-01T14:07:04.968139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 274 to 274
2025-10-01T14:07:04.968145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 274
2025-10-01T14:07:04.968156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 275 to 275
2025-10-01T14:07:04.968155Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 275
2025-10-01T14:07:04.968177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 276 to 276
2025-10-01T14:07:04.968182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 276
2025-10-01T14:07:04.968200Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 277 to 277
2025-10-01T14:07:04.968240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 277
2025-10-01T14:07:04.968266Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 278 to 278
2025-10-01T14:07:04.968299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 278
2025-10-01T14:07:04.968311Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968361Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968483Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 279 to 279
2025-10-01T14:07:04.968530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 279
2025-10-01T14:07:04.968567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 280 to 280
2025-10-01T14:07:04.968560Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 280
2025-10-01T14:07:04.968608Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 281 to 281
2025-10-01T14:07:04.968649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 281
2025-10-01T14:07:04.968646Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 282 to 282
2025-10-01T14:07:04.968694Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 282
2025-10-01T14:07:04.968731Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 283 to 283
2025-10-01T14:07:04.968761Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.968789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 283
2025-10-01T14:07:04.968792Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 284 to 284
2025-10-01T14:07:04.968823Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968906Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.968947Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969050Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969138Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 284
2025-10-01T14:07:04.969251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 285 to 285
2025-10-01T14:07:04.969259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 285
2025-10-01T14:07:04.969271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 286 to 286
2025-10-01T14:07:04.969240Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 286
2025-10-01T14:07:04.969326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 287 to 287
2025-10-01T14:07:04.969331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 287
2025-10-01T14:07:04.969340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 288 to 288
2025-10-01T14:07:04.969345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 288
2025-10-01T14:07:04.969353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 289 to 289
2025-10-01T14:07:04.969357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 289
2025-10-01T14:07:04.969367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 290 to 290
2025-10-01T14:07:04.969397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 290
2025-10-01T14:07:04.969426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 291 to 291
2025-10-01T14:07:04.969459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 291
2025-10-01T14:07:04.969517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 292 to 292
2025-10-01T14:07:04.969549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 292
2025-10-01T14:07:04.969579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 293 to 293
2025-10-01T14:07:04.969609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 293
2025-10-01T14:07:04.969637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 294 to 294
2025-10-01T14:07:04.969449Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 53 EndOffset 53 newEndOffset 73 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-01T14:07:04.969459Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 53 endOffset 73
2025-10-01T14:07:04.969462Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969473Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 53, endOffset# 73, WTime# 1759327624957, sizeLag# 139454
2025-10-01T14:07:04.969476Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.969489Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 2614b7f4-d746aa68-f123a04-8e030d62, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 167344, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.969503Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 167344 maxTimeLagMs 0 readTimestampMs 0 readOffset 53 EndOffset 73 ClientCommitOffset 0 committedOffset 0 Guid 2614b7f4-d746aa68-f123a04-8e030d62
2025-10-01T14:07:04.969667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 294
2025-10-01T14:07:04.969517Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 295 to 295
2025-10-01T14:07:04.969729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 295
2025-10-01T14:07:04.969730Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 296 to 296
2025-10-01T14:07:04.969796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 296
2025-10-01T14:07:04.969822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 297 to 297
2025-10-01T14:07:04.969850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 297
2025-10-01T14:07:04.969872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 298 to 298
2025-10-01T14:07:04.969818Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.969890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 298
2025-10-01T14:07:04.969901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 299 to 299
2025-10-01T14:07:04.969923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 299
2025-10-01T14:07:04.969952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write 1 messages with Id from 300 to 300
2025-10-01T14:07:04.969973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: try to update token
2025-10-01T14:07:04.969975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Send 1 message(s) (0 left), first sequence number is 300
2025-10-01T14:07:04.970726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.970738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 6
2025-10-01T14:07:04.970817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.970825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 7
2025-10-01T14:07:04.970864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.970867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 8
2025-10-01T14:07:04.970885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.970887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 9
2025-10-01T14:07:04.970913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.970916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 10
2025-10-01T14:07:04.970939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.970942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 11
2025-10-01T14:07:04.970953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.970955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 12
2025-10-01T14:07:04.970968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.970978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 13
2025-10-01T14:07:04.970997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 14
2025-10-01T14:07:04.971019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 15
2025-10-01T14:07:04.971037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 16
2025-10-01T14:07:04.971059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 17
2025-10-01T14:07:04.971080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 18
2025-10-01T14:07:04.971097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 19
2025-10-01T14:07:04.971117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 20
2025-10-01T14:07:04.971139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 21
2025-10-01T14:07:04.971157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 22
2025-10-01T14:07:04.971179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 23
2025-10-01T14:07:04.971196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 24
2025-10-01T14:07:04.971213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 25
2025-10-01T14:07:04.971232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 26
2025-10-01T14:07:04.971255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 27
2025-10-01T14:07:04.971276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 28
2025-10-01T14:07:04.971297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 29
2025-10-01T14:07:04.971318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-01T14:07:04.971321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 30
2025-10-01T14:07:04.971341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.971343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 31
2025-10-01T14:07:04.971363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.971365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 32
2025-10-01T14:07:04.971380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.971381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 33
2025-10-01T14:07:04.971395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.971399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 34
2025-10-01T14:07:04.971411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.971413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 35
2025-10-01T14:07:04.967861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.971425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 36
2025-10-01T14:07:04.971437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 37
2025-10-01T14:07:04.967867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-01T14:07:04.971453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 38
2025-10-01T14:07:04.967873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 119 partNo : 0 messageNo: 241 size 13063 offset: -1
2025-10-01T14:07:04.968017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.968019Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-01T14:07:04.968022Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 120 partNo : 0 messageNo: 242 size 13173 offset: -1
2025-10-01T14:07:04.971468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 39
2025-10-01T14:07:04.968036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.968037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 121 partNo : 0 messageNo: 243 size 13283 offset: -1
2025-10-01T14:07:04.968053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.968055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 122 partNo : 0 messageNo: 244 size 13393 offset: -1
2025-10-01T14:07:04.971485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-01T14:07:04.968076Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 40
2025-10-01T14:07:04.968077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 123 partNo : 0 messageNo: 245 size 13503 offset: -1
2025-10-01T14:07:04.968135Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.968137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.968144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.968148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-01T14:07:04.968153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 41
2025-10-01T14:07:04.971555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 42
2025-10-01T14:07:04.971578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 43
2025-10-01T14:07:04.971555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971589Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971594Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 44
2025-10-01T14:07:04.971600Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971629Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 45
2025-10-01T14:07:04.971636Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971646Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971650Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 46
2025-10-01T14:07:04.971659Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 47
2025-10-01T14:07:04.971670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971694Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 48
2025-10-01T14:07:04.971699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971714Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 49
2025-10-01T14:07:04.971726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971735Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.968160Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971740Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 50
2025-10-01T14:07:04.971747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.971771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 51
2025-10-01T14:07:04.968161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.968165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.968171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.968172Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.971793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 52
2025-10-01T14:07:04.968175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.971819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.971821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 53
2025-10-01T14:07:04.968176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.968179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.968181Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.968183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.968185Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.968186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.968200Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 53 count 20 size 139454 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.971851Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.971867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.968219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.971887Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.971898Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.968232Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 139300 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.968240Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.971903Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.968247Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-01T14:07:04.968251Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968253Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-01T14:07:04.968255Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-01T14:07:04.968259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-01T14:07:04.968265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-01T14:07:04.968269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-01T14:07:04.968274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-01T14:07:04.968278Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968281Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-01T14:07:04.968282Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968286Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-01T14:07:04.968288Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-01T14:07:04.968292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968295Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-01T14:07:04.968297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-01T14:07:04.968301Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968304Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-01T14:07:04.968306Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-01T14:07:04.968311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968316Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-01T14:07:04.968318Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968322Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-01T14:07:04.968323Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.972051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.972071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 54
2025-10-01T14:07:04.968328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-01T14:07:04.968330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968333Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-01T14:07:04.968335Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-01T14:07:04.968340Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.968343Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-01T14:07:04.968797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.968825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.968841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:04.968863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-01T14:07:04.968922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 8187 count 1 nextOffset 74 batches 1
2025-10-01T14:07:04.968930Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-01T14:07:04.968934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 16452 count 2 nextOffset 75 batches 1
2025-10-01T14:07:04.968936Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-01T14:07:04.968940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 24827 count 3 nextOffset 76 batches 1
2025-10-01T14:07:04.968944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-01T14:07:04.968950Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 33312 count 4 nextOffset 77 batches 1
2025-10-01T14:07:04.968953Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-01T14:07:04.968959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 41907 count 5 nextOffset 78 batches 1
2025-10-01T14:07:04.968962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-01T14:07:04.968968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 50612 count 6 nextOffset 79 batches 1
2025-10-01T14:07:04.968970Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-01T14:07:04.968974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 59427 count 7 nextOffset 80 batches 1
2025-10-01T14:07:04.968978Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-01T14:07:04.968981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 68352 count 8 nextOffset 81 batches 1
2025-10-01T14:07:04.968984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-01T14:07:04.968988Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 77387 count 9 nextOffset 82 batches 1
2025-10-01T14:07:04.968991Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-01T14:07:04.968994Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 86532 count 10 nextOffset 83 batches 1
2025-10-01T14:07:04.968997Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-01T14:07:04.968999Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 95787 count 11 nextOffset 84 batches 1
2025-10-01T14:07:04.969001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-01T14:07:04.969005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 105152 count 12 nextOffset 85 batches 1
2025-10-01T14:07:04.969007Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-01T14:07:04.969011Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 114627 count 13 nextOffset 86 batches 1
2025-10-01T14:07:04.969013Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-01T14:07:04.969017Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 124212 count 14 nextOffset 87 batches 1
2025-10-01T14:07:04.969019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-01T14:07:04.969024Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 133907 count 15 nextOffset 88 batches 1
2025-10-01T14:07:04.969026Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-01T14:07:04.969029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 143712 count 16 nextOffset 89 batches 1
2025-10-01T14:07:04.969032Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-01T14:07:04.969036Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 153627 count 17 nextOffset 90 batches 1
2025-10-01T14:07:04.969039Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-01T14:07:04.969042Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 163652 count 18 nextOffset 91 batches 1
2025-10-01T14:07:04.972250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.972265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 55
2025-10-01T14:07:04.969044Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-01T14:07:04.969048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 173787 count 19 nextOffset 92 batches 1
2025-10-01T14:07:04.969050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-01T14:07:04.969053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 184032 count 20 nextOffset 93 batches 1
2025-10-01T14:07:04.969056Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-01T14:07:04.969059Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 194387 count 21 nextOffset 94 batches 1
2025-10-01T14:07:04.972283Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.972314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.972318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 56
2025-10-01T14:07:04.969062Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-01T14:07:04.969067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 204852 count 22 nextOffset 95 batches 1
2025-10-01T14:07:04.969070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-01T14:07:04.969073Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 215427 count 23 nextOffset 96 batches 1
2025-10-01T14:07:04.969077Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-01T14:07:04.969080Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 226112 count 24 nextOffset 97 batches 1
2025-10-01T14:07:04.969082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-01T14:07:04.972358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 57 offsets: 56 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.969085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 236907 count 25 nextOffset 98 batches 1
2025-10-01T14:07:04.969088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-01T14:07:04.972369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 57
2025-10-01T14:07:04.969091Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 247812 count 26 nextOffset 99 batches 1
2025-10-01T14:07:04.969094Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-01T14:07:04.969097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 258827 count 27 nextOffset 100 batches 1
2025-10-01T14:07:04.969100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 101 partNo 0
2025-10-01T14:07:04.969116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 101 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 269952 count 28 nextOffset 101 batches 1
2025-10-01T14:07:04.969119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 102 partNo 0
2025-10-01T14:07:04.969122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 102 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 281187 count 29 nextOffset 102 batches 1
2025-10-01T14:07:04.969125Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 103 partNo 0
2025-10-01T14:07:04.969128Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 103 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 292532 count 30 nextOffset 103 batches 1
2025-10-01T14:07:04.969131Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 104 partNo 0
2025-10-01T14:07:04.969134Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 104 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 303987 count 31 nextOffset 104 batches 1
2025-10-01T14:07:04.969137Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 105 partNo 0
2025-10-01T14:07:04.969140Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 105 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 315552 count 32 nextOffset 105 batches 1
2025-10-01T14:07:04.969143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 106 partNo 0
2025-10-01T14:07:04.972415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 58 offsets: 57 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.969149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 106 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 327227 count 33 nextOffset 106 batches 1
2025-10-01T14:07:04.969153Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 107 partNo 0
2025-10-01T14:07:04.972430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 58
2025-10-01T14:07:04.969155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 107 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 339012 count 34 nextOffset 107 batches 1
2025-10-01T14:07:04.969158Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 108 partNo 0
2025-10-01T14:07:04.969161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 108 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 350907 count 35 nextOffset 108 batches 1
2025-10-01T14:07:04.969164Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 109 partNo 0
2025-10-01T14:07:04.969168Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 109 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 362912 count 36 nextOffset 109 batches 1
2025-10-01T14:07:04.969170Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 110 partNo 0
2025-10-01T14:07:04.969174Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 110 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 375027 count 37 nextOffset 110 batches 1
2025-10-01T14:07:04.972452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 59 offsets: 58 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.969176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 111 partNo 0
2025-10-01T14:07:04.972455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 59
2025-10-01T14:07:04.969182Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 111 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 387252 count 38 nextOffset 111 batches 1
2025-10-01T14:07:04.969184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 112 partNo 0
2025-10-01T14:07:04.969187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 112 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 399587 count 39 nextOffset 112 batches 1
2025-10-01T14:07:04.969191Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 113 partNo 0
2025-10-01T14:07:04.969194Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 113 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 412032 count 40 nextOffset 113 batches 1
2025-10-01T14:07:04.972479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 60 offsets: 59 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.969197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 114 partNo 0
2025-10-01T14:07:04.972482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 60
2025-10-01T14:07:04.969200Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 114 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 424587 count 41 nextOffset 114 batches 1
2025-10-01T14:07:04.969203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 115 partNo 0
2025-10-01T14:07:04.969206Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 115 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 437252 count 42 nextOffset 115 batches 1
2025-10-01T14:07:04.969208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 116 partNo 0
2025-10-01T14:07:04.969212Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 116 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 450027 count 43 nextOffset 116 batches 1
2025-10-01T14:07:04.969214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 117 partNo 0
2025-10-01T14:07:04.972500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 61 offsets: 60 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.972507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 61
2025-10-01T14:07:04.969217Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 117 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 462912 count 44 nextOffset 117 batches 1
2025-10-01T14:07:04.969220Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 118 partNo 0
2025-10-01T14:07:04.969224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 118 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 475907 count 45 nextOffset 118 batches 1
2025-10-01T14:07:04.969226Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 119 partNo 0
2025-10-01T14:07:04.969229Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 119 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 489012 count 46 nextOffset 119 batches 1
2025-10-01T14:07:04.969232Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 120 partNo 0
2025-10-01T14:07:04.969235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 120 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 502227 count 47 nextOffset 120 batches 1
2025-10-01T14:07:04.969238Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 121 partNo 0
2025-10-01T14:07:04.969363Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 53 partno 0 count 20 parts 0 suffix '63' size 139454
2025-10-01T14:07:04.970241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 121 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 514078 count 48 nextOffset 121 batches 1
2025-10-01T14:07:04.970255Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 122 partNo 0
2025-10-01T14:07:04.970283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 122 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 527545 count 49 nextOffset 122 batches 2
2025-10-01T14:07:04.972523Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 73 Result { Offset: 53 Data: "... 5913 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 5841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 6023 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 5951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 6133 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 6243 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 6353 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 6463 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 6573 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 6683 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 6793 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 6903 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 7013 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 6941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 7123 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 7051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 7233 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 7161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 7343 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 7271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 7453 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 7381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 7563 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624947 UncompressedSize: 7491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 7673 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624949 UncompressedSize: 7601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 7783 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624949 UncompressedSize: 7711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 7893 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624949 UncompressedSize: 7821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 8003 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1759327624960 CreateTimestampMS: 1759327624949 UncompressedSize: 7931 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551070 RealReadOffset: 72 WaitQuotaTimeMs: 0 EndOffset: 73 StartOffset: 0 } Cookie: 53 }
2025-10-01T14:07:04.970287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 123 partNo 0
2025-10-01T14:07:04.970291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 123 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 541090 count 50 nextOffset 123 batches 2
2025-10-01T14:07:04.970294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.970393Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 73,50 HeadOffset 73 endOffset 73 curOffset 123 d0000000000_00000000000000000073_00000_0000000050_00000? size 541088 WTime 1759327624970
2025-10-01T14:07:04.970811Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.970813Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.970815Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.970818Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:04.970822Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:04.970824Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:04.970826Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 6 keys were taken away. Let's read 296384 bytes (296384)
2025-10-01T14:07:04.970830Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 6, size 296384 (8388608)
2025-10-01T14:07:04.970848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 246  requestId: <none> cookie: 124
2025-10-01T14:07:04.970867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 247  requestId: <none> cookie: 125
2025-10-01T14:07:04.970877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 248  requestId: <none> cookie: 126
2025-10-01T14:07:04.970887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 249  requestId: <none> cookie: 127
2025-10-01T14:07:04.970892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 250  requestId: <none> cookie: 128
2025-10-01T14:07:04.970899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 54
2025-10-01T14:07:04.970907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 55
2025-10-01T14:07:04.970913Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 56
2025-10-01T14:07:04.970918Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 57
2025-10-01T14:07:04.970924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 58
2025-10-01T14:07:04.970930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 59
2025-10-01T14:07:04.972611Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 73
2025-10-01T14:07:04.970935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 60
2025-10-01T14:07:04.972623Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 73 ReadOffset 73 ReadGuid 2614b7f4-d746aa68-f123a04-8e030d62 has messages 1
2025-10-01T14:07:04.970941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 61
2025-10-01T14:07:04.970946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 62
2025-10-01T14:07:04.970952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 63
2025-10-01T14:07:04.970958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 64
2025-10-01T14:07:04.970964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 65
2025-10-01T14:07:04.970969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 66
2025-10-01T14:07:04.970975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 67
2025-10-01T14:07:04.970979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 68
2025-10-01T14:07:04.970984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 69
2025-10-01T14:07:04.970988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 70
2025-10-01T14:07:04.970994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 71
2025-10-01T14:07:04.970999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 72
2025-10-01T14:07:04.971004Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 73
2025-10-01T14:07:04.971031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971051Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.971063Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 73 partNo 0 count 50 size 541088
2025-10-01T14:07:04.971146Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 53 count 24 size 167344 endOffset 73 max time lag 0ms effective offset 53
2025-10-01T14:07:04.971157Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 139454 count 20 last offset 53, current partition end offset: 73
2025-10-01T14:07:04.971161Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-01T14:07:04.972672Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 2614b7f4-d746aa68-f123a04-8e030d62, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 138553
2025-10-01T14:07:04.972685Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 2614b7f4-d746aa68-f123a04-8e030d62
2025-10-01T14:07:04.971171Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 53 partno 0 count 20 parts_count 0 source 1 size 139454 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.971175Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-01T14:07:04.971184Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.971221Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 53 partno 0 count 20 parts 0 suffix '63'
2025-10-01T14:07:04.971272Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 53 totakecount 20 count 20 size 139432 from pos 0 cbcount 20
2025-10-01T14:07:04.971322Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 53
2025-10-01T14:07:04.971902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 124 partNo : 0 messageNo: 251 size 13613 offset: -1
2025-10-01T14:07:04.971931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 125 partNo : 0 messageNo: 252 size 13723 offset: -1
2025-10-01T14:07:04.971947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 126 partNo : 0 messageNo: 253 size 13833 offset: -1
2025-10-01T14:07:04.971963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.971968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 127 partNo : 0 messageNo: 254 size 13943 offset: -1
2025-10-01T14:07:04.971997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.971998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.972001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 128 partNo : 0 messageNo: 255 size 14054 offset: -1
2025-10-01T14:07:04.972006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.972015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.972017Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.972019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.972021Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.972023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.972024Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.972026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.972028Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.972030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.972347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.972352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.972361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.972363Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.972367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.972369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.972373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.972374Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.972378Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.972380Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.972398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 256  requestId: <none> cookie: 129
2025-10-01T14:07:04.972409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 257  requestId: <none> cookie: 130
2025-10-01T14:07:04.972412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 258  requestId: <none> cookie: 131
2025-10-01T14:07:04.972414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 259  requestId: <none> cookie: 132
2025-10-01T14:07:04.972417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 260  requestId: <none> cookie: 133
2025-10-01T14:07:04.972973Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.973071Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973087Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973095Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973102Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973115Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 129 partNo : 0 messageNo: 261 size 14164 offset: -1
2025-10-01T14:07:04.973271Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973283Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973277Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 130 partNo : 0 messageNo: 262 size 14274 offset: -1
2025-10-01T14:07:04.973296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 131 partNo : 0 messageNo: 263 size 14384 offset: -1
2025-10-01T14:07:04.973316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973324Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 132 partNo : 0 messageNo: 264 size 14494 offset: -1
2025-10-01T14:07:04.973334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 133 partNo : 0 messageNo: 265 size 14604 offset: -1
2025-10-01T14:07:04.973348Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973384Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973356Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973400Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973447Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 266  requestId: <none> cookie: 134
2025-10-01T14:07:04.973442Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 267  requestId: <none> cookie: 135
2025-10-01T14:07:04.973468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 268  requestId: <none> cookie: 136
2025-10-01T14:07:04.973470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 269  requestId: <none> cookie: 137
2025-10-01T14:07:04.973472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 270  requestId: <none> cookie: 138
2025-10-01T14:07:04.973493Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973530Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973542Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973546Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973630Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 134 partNo : 0 messageNo: 271 size 14714 offset: -1
2025-10-01T14:07:04.973649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973651Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973654Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 135 partNo : 0 messageNo: 272 size 14824 offset: -1
2025-10-01T14:07:04.973649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973659Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973671Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 136 partNo : 0 messageNo: 273 size 14934 offset: -1
2025-10-01T14:07:04.973680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 137 partNo : 0 messageNo: 274 size 15044 offset: -1
2025-10-01T14:07:04.973691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973701Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 138 partNo : 0 messageNo: 275 size 15154 offset: -1
2025-10-01T14:07:04.973722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973727Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973731Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973735Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.973738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.973742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.973772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.973781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 276  requestId: <none> cookie: 139
2025-10-01T14:07:04.973772Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 277  requestId: <none> cookie: 140
2025-10-01T14:07:04.973797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 278  requestId: <none> cookie: 141
2025-10-01T14:07:04.973799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 279  requestId: <none> cookie: 142
2025-10-01T14:07:04.973802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 280  requestId: <none> cookie: 143
2025-10-01T14:07:04.973826Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.973834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973839Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973843Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973876Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.973943Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973967Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973977Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973983Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973993Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.973985Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 139 partNo : 0 messageNo: 281 size 15264 offset: -1
2025-10-01T14:07:04.974020Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974032Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974038Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 140 partNo : 0 messageNo: 282 size 15374 offset: -1
2025-10-01T14:07:04.974051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974057Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 141 partNo : 0 messageNo: 283 size 15484 offset: -1
2025-10-01T14:07:04.974070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974069Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 142 partNo : 0 messageNo: 284 size 15594 offset: -1
2025-10-01T14:07:04.974087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974092Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 143 partNo : 0 messageNo: 285 size 15704 offset: -1
2025-10-01T14:07:04.974101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974113Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974122Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974117Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974141Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974150Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974162Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 286  requestId: <none> cookie: 144
2025-10-01T14:07:04.974180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 287  requestId: <none> cookie: 145
2025-10-01T14:07:04.974186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 288  requestId: <none> cookie: 146
2025-10-01T14:07:04.974188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 289  requestId: <none> cookie: 147
2025-10-01T14:07:04.974191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 290  requestId: <none> cookie: 148
2025-10-01T14:07:04.974203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974223Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974227Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974330Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974338Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974349Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 144 partNo : 0 messageNo: 291 size 15814 offset: -1
2025-10-01T14:07:04.974360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 145 partNo : 0 messageNo: 292 size 15924 offset: -1
2025-10-01T14:07:04.974388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 146 partNo : 0 messageNo: 293 size 16034 offset: -1
2025-10-01T14:07:04.974406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 147 partNo : 0 messageNo: 294 size 16144 offset: -1
2025-10-01T14:07:04.974419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 148 partNo : 0 messageNo: 295 size 16254 offset: -1
2025-10-01T14:07:04.974426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974431Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974439Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 296  requestId: <none> cookie: 149
2025-10-01T14:07:04.974459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 297  requestId: <none> cookie: 150
2025-10-01T14:07:04.974486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 298  requestId: <none> cookie: 151
2025-10-01T14:07:04.974489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 299  requestId: <none> cookie: 152
2025-10-01T14:07:04.974492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 300  requestId: <none> cookie: 153
2025-10-01T14:07:04.974607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 62 offsets: 61 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974390Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 62
2025-10-01T14:07:04.974437Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974492Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974577Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.974597Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 63 offsets: 62 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 63
2025-10-01T14:07:04.974684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 64 offsets: 63 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 64
2025-10-01T14:07:04.974699Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 138553, now ReadSizeBudget = 0, ReadSizeServerDelta = 385735
2025-10-01T14:07:04.974707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 65 offsets: 64 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 65
2025-10-01T14:07:04.974724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 66 offsets: 65 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 66
2025-10-01T14:07:04.974719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974729Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974738Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 385735
2025-10-01T14:07:04.974743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 67 offsets: 66 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 67
2025-10-01T14:07:04.974740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 149 partNo : 0 messageNo: 301 size 16364 offset: -1
2025-10-01T14:07:04.974722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 68 offsets: 67 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.974739Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 68
2025-10-01T14:07:04.974769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974804Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (53-72)
2025-10-01T14:07:04.974775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.974808Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974827Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 138553 to budget
2025-10-01T14:07:04.974777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 150 partNo : 0 messageNo: 302 size 16475 offset: -1
2025-10-01T14:07:04.974809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974850Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 138553, ReadSizeServerDelta = 385735
2025-10-01T14:07:04.974851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 7 }
2025-10-01T14:07:04.974815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 151 partNo : 0 messageNo: 303 size 16585 offset: -1
2025-10-01T14:07:04.974842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 69
2025-10-01T14:07:04.974844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 152 partNo : 0 messageNo: 304 size 16695 offset: -1
2025-10-01T14:07:04.974897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 70 offsets: 69 already_written: false write_statistics { persist_duration_ms: 7 }
2025-10-01T14:07:04.974901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 70
2025-10-01T14:07:04.974886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 153 partNo : 0 messageNo: 305 size 16805 offset: -1
2025-10-01T14:07:04.974901Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974923Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.974912Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974926Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974941Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (53-53)
2025-10-01T14:07:04.974938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 71 offsets: 70 already_written: false write_statistics { persist_duration_ms: 7 }
2025-10-01T14:07:04.974968Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (54-54)
2025-10-01T14:07:04.974971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 71
2025-10-01T14:07:04.974952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.974963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.974966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.974968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.974906Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 306  requestId: <none> cookie: 154
2025-10-01T14:07:04.974988Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (55-55)
2025-10-01T14:07:04.974990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 307  requestId: <none> cookie: 155
2025-10-01T14:07:04.974998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 72 offsets: 71 already_written: false write_statistics { persist_duration_ms: 7 }
2025-10-01T14:07:04.974993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 308  requestId: <none> cookie: 156
2025-10-01T14:07:04.975011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 72
2025-10-01T14:07:04.975013Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (56-56)
2025-10-01T14:07:04.975003Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.974996Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 309  requestId: <none> cookie: 157
2025-10-01T14:07:04.974998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 310  requestId: <none> cookie: 158
2025-10-01T14:07:04.975045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 73 offsets: 72 already_written: false write_statistics { persist_duration_ms: 7 }
2025-10-01T14:07:04.975048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 73
2025-10-01T14:07:04.975077Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 138553 } }
2025-10-01T14:07:04.975085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (57-57)
2025-10-01T14:07:04.975100Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (58-58)
2025-10-01T14:07:04.975103Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (59-59)
2025-10-01T14:07:04.975108Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (60-60)
2025-10-01T14:07:04.975098Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975113Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975124Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 8076e52b-47ab2f14-d4168f5c-8aeabbef
2025-10-01T14:07:04.975133Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (61-61)
2025-10-01T14:07:04.975137Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (62-62)
2025-10-01T14:07:04.975140Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (63-63)
2025-10-01T14:07:04.975144Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (64-64)
2025-10-01T14:07:04.975149Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (65-65)
2025-10-01T14:07:04.975153Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (66-66)
2025-10-01T14:07:04.975157Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (67-67)
2025-10-01T14:07:04.975160Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (68-68)
2025-10-01T14:07:04.975206Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (69-69)
2025-10-01T14:07:04.975210Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (70-70)
2025-10-01T14:07:04.975213Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (71-71)
2025-10-01T14:07:04.975197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975219Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (72-72)
2025-10-01T14:07:04.975235Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975245Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975271Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 154 partNo : 0 messageNo: 311 size 16915 offset: -1
2025-10-01T14:07:04.975302Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 155 partNo : 0 messageNo: 312 size 17025 offset: -1
2025-10-01T14:07:04.975328Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 156 partNo : 0 messageNo: 313 size 17135 offset: -1
2025-10-01T14:07:04.975344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 157 partNo : 0 messageNo: 314 size 17245 offset: -1
2025-10-01T14:07:04.975368Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 158 partNo : 0 messageNo: 315 size 17355 offset: -1
2025-10-01T14:07:04.975367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975378Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975384Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975402Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975403Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975430Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975416Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
>>> event from dataHandler: 2025-10-01T14:07:04.975420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 316  requestId: <none> cookie: 159
2025-10-01T14:07:04.975449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 317  requestId: <none> cookie: 160
2025-10-01T14:07:04.975468Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 318  requestId: <none> cookie: 161
2025-10-01T14:07:04.975454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 319  requestId: <none> cookie: 162
2025-10-01T14:07:04.975457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 320  requestId: <none> cookie: 163
2025-10-01T14:07:04.975497Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..5841 bytes.. Information: { Offset: 53 ProducerId: "src_id" SeqNo: 54 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5951 bytes.. Information: { Offset: 54 ProducerId: "src_id" SeqNo: 55 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6061 bytes.. Information: { Offset: 55 ProducerId: "src_id" SeqNo: 56 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6171 bytes.. Information: { Offset: 56 ProducerId: "src_id" SeqNo: 57 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6281 bytes.. Information: { Offset: 57 ProducerId: "src_id" SeqNo: 58 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6391 bytes.. Information: { Offset: 58 ProducerId: "src_id" SeqNo: 59 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6501 bytes.. Information: { Offset: 59 ProducerId: "src_id" SeqNo: 60 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6611 bytes.. Information: { Offset: 60 ProducerId: "src_id" SeqNo: 61 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6721 bytes.. Information: { Offset: 61 ProducerId: "src_id" SeqNo: 62 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6831 bytes.. Information: { Offset: 62 ProducerId: "src_id" SeqNo: 63 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6941 bytes.. Information: { Offset: 63 ProducerId: "src_id" SeqNo: 64 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7051 bytes.. Information: { Offset: 64 ProducerId: "src_id" SeqNo: 65 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7161 bytes.. Information: { Offset: 65 ProducerId: "src_id" SeqNo: 66 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7271 bytes.. Information: { Offset: 66 ProducerId: "src_id" SeqNo: 67 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7381 bytes.. Information: { Offset: 67 ProducerId: "src_id" SeqNo: 68 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7491 bytes.. Information: { Offset: 68 ProducerId: "src_id" SeqNo: 69 CreateTime: 2025-10-01T14:07:04.947000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7601 bytes.. Information: { Offset: 69 ProducerId: "src_id" SeqNo: 70 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7711 bytes.. Information: { Offset: 70 ProducerId: "src_id" SeqNo: 71 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7821 bytes.. Information: { Offset: 71 ProducerId: "src_id" SeqNo: 72 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7931 bytes.. Information: { Offset: 72 ProducerId: "src_id" SeqNo: 73 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.960000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.975513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975526Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975530Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975601Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 20, size 137720 bytes
2025-10-01T14:07:04.975612Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.975624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975650Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975677Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.975703Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 159 partNo : 0 messageNo: 321 size 17465 offset: -1
2025-10-01T14:07:04.975743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975750Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975754Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 160 partNo : 0 messageNo: 322 size 17575 offset: -1
2025-10-01T14:07:04.975765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 161 partNo : 0 messageNo: 323 size 17685 offset: -1
2025-10-01T14:07:04.975752Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 162 partNo : 0 messageNo: 324 size 17795 offset: -1
2025-10-01T14:07:04.975831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975837Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 163 partNo : 0 messageNo: 325 size 17905 offset: -1
2025-10-01T14:07:04.975846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975850Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975878Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.975895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.975889Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.975898Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975904Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.975915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.975928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 326  requestId: <none> cookie: 164
2025-10-01T14:07:04.975943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 327  requestId: <none> cookie: 165
2025-10-01T14:07:04.975961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 328  requestId: <none> cookie: 166
2025-10-01T14:07:04.975964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 329  requestId: <none> cookie: 167
2025-10-01T14:07:04.975967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 330  requestId: <none> cookie: 168
2025-10-01T14:07:04.975972Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.975998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 164 partNo : 0 messageNo: 331 size 18015 offset: -1
2025-10-01T14:07:04.976108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976123Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 165 partNo : 0 messageNo: 332 size 18125 offset: -1
2025-10-01T14:07:04.976158Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.976185Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976194Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 166 partNo : 0 messageNo: 333 size 18235 offset: -1
2025-10-01T14:07:04.976220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 167 partNo : 0 messageNo: 334 size 18345 offset: -1
2025-10-01T14:07:04.976252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 168 partNo : 0 messageNo: 335 size 18455 offset: -1
2025-10-01T14:07:04.976265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.976269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.976270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.976272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.976274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.976276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.976280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976312Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976299Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.976315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.976317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.976320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.976322Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.976324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.976326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.976335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 336  requestId: <none> cookie: 169
2025-10-01T14:07:04.976344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 337  requestId: <none> cookie: 170
2025-10-01T14:07:04.976347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 338  requestId: <none> cookie: 171
2025-10-01T14:07:04.976350Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 339  requestId: <none> cookie: 172
2025-10-01T14:07:04.976353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 340  requestId: <none> cookie: 173
2025-10-01T14:07:04.976369Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.976379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976432Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976441Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976472Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976482Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.976807Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976819Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.976856Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976941Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976950Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.976964Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.977023Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.977083Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.977180Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.977374Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 169 partNo : 0 messageNo: 341 size 18565 offset: -1
2025-10-01T14:07:04.977415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 170 partNo : 0 messageNo: 342 size 18675 offset: -1
2025-10-01T14:07:04.977445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 171 partNo : 0 messageNo: 343 size 18785 offset: -1
2025-10-01T14:07:04.977509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977515Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 172 partNo : 0 messageNo: 344 size 18895 offset: -1
2025-10-01T14:07:04.977539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 173 partNo : 0 messageNo: 345 size 19005 offset: -1
2025-10-01T14:07:04.977553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977565Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977572Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.977581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.977585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.977597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.977599Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.977602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.977604Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.977607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.977608Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.977610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.977621Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 346  requestId: <none> cookie: 174
2025-10-01T14:07:04.977633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 347  requestId: <none> cookie: 175
2025-10-01T14:07:04.977640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 348  requestId: <none> cookie: 176
2025-10-01T14:07:04.977642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 349  requestId: <none> cookie: 177
2025-10-01T14:07:04.977645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 350  requestId: <none> cookie: 178
2025-10-01T14:07:04.977685Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.977701Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.977705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.977710Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.977720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.977788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.977808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.977840Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.977847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.977851Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.977874Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.977902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977909Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 174 partNo : 0 messageNo: 351 size 19115 offset: -1
2025-10-01T14:07:04.977942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 175 partNo : 0 messageNo: 352 size 19225 offset: -1
2025-10-01T14:07:04.977970Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.977976Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.977980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 176 partNo : 0 messageNo: 353 size 19335 offset: -1
2025-10-01T14:07:04.978005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 177 partNo : 0 messageNo: 354 size 19445 offset: -1
2025-10-01T14:07:04.978020Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 178 partNo : 0 messageNo: 355 size 19555 offset: -1
2025-10-01T14:07:04.978063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978076Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978092Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978099Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978102Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978107Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978094Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978112Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 356  requestId: <none> cookie: 179
2025-10-01T14:07:04.978131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 357  requestId: <none> cookie: 180
2025-10-01T14:07:04.978134Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 358  requestId: <none> cookie: 181
2025-10-01T14:07:04.978138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 359  requestId: <none> cookie: 182
2025-10-01T14:07:04.978141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 360  requestId: <none> cookie: 183
2025-10-01T14:07:04.978157Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978243Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978249Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978254Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978322Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 179 partNo : 0 messageNo: 361 size 19665 offset: -1
2025-10-01T14:07:04.978357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978368Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978384Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978394Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978408Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 180 partNo : 0 messageNo: 362 size 19775 offset: -1
2025-10-01T14:07:04.978407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 181 partNo : 0 messageNo: 363 size 19885 offset: -1
2025-10-01T14:07:04.978423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 182 partNo : 0 messageNo: 364 size 19995 offset: -1
2025-10-01T14:07:04.978482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978488Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 183 partNo : 0 messageNo: 365 size 20105 offset: -1
2025-10-01T14:07:04.978498Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978504Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978512Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978521Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978540Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978548Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 366  requestId: <none> cookie: 184
2025-10-01T14:07:04.978568Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 367  requestId: <none> cookie: 185
2025-10-01T14:07:04.978571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 368  requestId: <none> cookie: 186
2025-10-01T14:07:04.978574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 369  requestId: <none> cookie: 187
2025-10-01T14:07:04.978561Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 370  requestId: <none> cookie: 188
2025-10-01T14:07:04.978688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978724Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978729Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978875Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978896Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978907Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.978914Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978997Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979049Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.978873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 184 partNo : 0 messageNo: 371 size 20215 offset: -1
2025-10-01T14:07:04.978910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979084Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 185 partNo : 0 messageNo: 372 size 20325 offset: -1
2025-10-01T14:07:04.978926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 186 partNo : 0 messageNo: 373 size 20435 offset: -1
2025-10-01T14:07:04.978941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 187 partNo : 0 messageNo: 374 size 20545 offset: -1
2025-10-01T14:07:04.979107Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978955Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979111Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.978957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 188 partNo : 0 messageNo: 375 size 20655 offset: -1
2025-10-01T14:07:04.978963Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978969Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978972Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978977Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978982Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.978985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.978989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.978995Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.978997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.979001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 376  requestId: <none> cookie: 189
2025-10-01T14:07:04.979035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 377  requestId: <none> cookie: 190
2025-10-01T14:07:04.979037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 378  requestId: <none> cookie: 191
2025-10-01T14:07:04.979040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 379  requestId: <none> cookie: 192
2025-10-01T14:07:04.979043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 380  requestId: <none> cookie: 193
2025-10-01T14:07:04.979186Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979198Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979230Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979303Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979345Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979397Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979448Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.979461Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.979465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.979470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.979250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.979261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 189 partNo : 0 messageNo: 381 size 20765 offset: -1
2025-10-01T14:07:04.979285Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 190 partNo : 0 messageNo: 382 size 20875 offset: -1
2025-10-01T14:07:04.979300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 191 partNo : 0 messageNo: 383 size 20985 offset: -1
2025-10-01T14:07:04.979313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979314Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979317Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 192 partNo : 0 messageNo: 384 size 21095 offset: -1
2025-10-01T14:07:04.979327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 193 partNo : 0 messageNo: 385 size 21205 offset: -1
2025-10-01T14:07:04.979336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979345Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979360Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979365Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979371Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979380Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 386  requestId: <none> cookie: 194
2025-10-01T14:07:04.979417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 387  requestId: <none> cookie: 195
2025-10-01T14:07:04.979434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 388  requestId: <none> cookie: 196
2025-10-01T14:07:04.979436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 389  requestId: <none> cookie: 197
2025-10-01T14:07:04.979439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 390  requestId: <none> cookie: 198
2025-10-01T14:07:04.979592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979604Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979589Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979602Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 194 partNo : 0 messageNo: 391 size 21315 offset: -1
2025-10-01T14:07:04.979615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.979630Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979646Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 195 partNo : 0 messageNo: 392 size 21425 offset: -1
2025-10-01T14:07:04.979658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 196 partNo : 0 messageNo: 393 size 21535 offset: -1
2025-10-01T14:07:04.979678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979683Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979687Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 197 partNo : 0 messageNo: 394 size 21645 offset: -1
2025-10-01T14:07:04.979697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 198 partNo : 0 messageNo: 395 size 21755 offset: -1
2025-10-01T14:07:04.979695Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.979712Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979756Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.979779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.979782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.979788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.979801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 396  requestId: <none> cookie: 199
2025-10-01T14:07:04.979811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 397  requestId: <none> cookie: 200
2025-10-01T14:07:04.979818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 398  requestId: <none> cookie: 201
2025-10-01T14:07:04.979821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 399  requestId: <none> cookie: 202
2025-10-01T14:07:04.979823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 400  requestId: <none> cookie: 203
2025-10-01T14:07:04.980034Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980223Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980245Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980262Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 199 partNo : 0 messageNo: 401 size 21865 offset: -1
2025-10-01T14:07:04.980311Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 200 partNo : 0 messageNo: 402 size 21975 offset: -1
2025-10-01T14:07:04.980344Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 201 partNo : 0 messageNo: 403 size 22085 offset: -1
2025-10-01T14:07:04.980409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 202 partNo : 0 messageNo: 404 size 22195 offset: -1
2025-10-01T14:07:04.980458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 203 partNo : 0 messageNo: 405 size 22305 offset: -1
2025-10-01T14:07:04.980479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.980493Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.980499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980507Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980513Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980524Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.980525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.980528Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.980535Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.980533Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.980535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.980565Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.980539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.980541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.980543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.980554Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 406  requestId: <none> cookie: 204
2025-10-01T14:07:04.980561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 407  requestId: <none> cookie: 205
2025-10-01T14:07:04.980564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 408  requestId: <none> cookie: 206
2025-10-01T14:07:04.980581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 409  requestId: <none> cookie: 207
2025-10-01T14:07:04.980585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 410  requestId: <none> cookie: 208
2025-10-01T14:07:04.980585Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980600Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980604Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.980661Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 73 count 50 size 541088 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.980678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.980687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980691Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 73 partno 0 count 50 parts 0 suffix '63' size 541088
2025-10-01T14:07:04.980696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 540750 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.980705Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980729Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980734Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980712Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-01T14:07:04.980740Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.980720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-01T14:07:04.980724Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980726Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-01T14:07:04.980729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980731Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-01T14:07:04.980733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980736Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-01T14:07:04.980743Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980761Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980746Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-01T14:07:04.980748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980751Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-01T14:07:04.980753Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-01T14:07:04.980758Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-01T14:07:04.980763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980767Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-01T14:07:04.980769Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980773Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-01T14:07:04.980775Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-01T14:07:04.980782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980785Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-01T14:07:04.980787Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980789Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-01T14:07:04.980791Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980793Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-01T14:07:04.980795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980799Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-01T14:07:04.980801Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-01T14:07:04.980806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980809Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-01T14:07:04.980810Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980813Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-01T14:07:04.980815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980818Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-01T14:07:04.980820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980841Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-01T14:07:04.980843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980848Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-01T14:07:04.980850Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980853Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-01T14:07:04.980855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980861Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-01T14:07:04.980863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980866Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-01T14:07:04.980868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-01T14:07:04.980873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-01T14:07:04.980879Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980882Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 101, partNo: 0, Offset: 100 is stored on disk
2025-10-01T14:07:04.980883Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 102, partNo: 0, Offset: 101 is stored on disk
2025-10-01T14:07:04.980889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980892Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 103, partNo: 0, Offset: 102 is stored on disk
2025-10-01T14:07:04.980894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980897Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 104, partNo: 0, Offset: 103 is stored on disk
2025-10-01T14:07:04.980907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 105, partNo: 0, Offset: 104 is stored on disk
2025-10-01T14:07:04.980915Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980918Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 106, partNo: 0, Offset: 105 is stored on disk
2025-10-01T14:07:04.980919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 107, partNo: 0, Offset: 106 is stored on disk
2025-10-01T14:07:04.980924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980926Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 108, partNo: 0, Offset: 107 is stored on disk
2025-10-01T14:07:04.980920Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 109, partNo: 0, Offset: 108 is stored on disk
2025-10-01T14:07:04.980933Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980935Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 110, partNo: 0, Offset: 109 is stored on disk
2025-10-01T14:07:04.980937Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 111, partNo: 0, Offset: 110 is stored on disk
2025-10-01T14:07:04.980941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 112, partNo: 0, Offset: 111 is stored on disk
2025-10-01T14:07:04.980946Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980951Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 113, partNo: 0, Offset: 112 is stored on disk
2025-10-01T14:07:04.980952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980956Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 114, partNo: 0, Offset: 113 is stored on disk
2025-10-01T14:07:04.980957Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 115, partNo: 0, Offset: 114 is stored on disk
2025-10-01T14:07:04.980971Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.981007Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.980967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 116, partNo: 0, Offset: 115 is stored on disk
2025-10-01T14:07:04.980969Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980973Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 117, partNo: 0, Offset: 116 is stored on disk
2025-10-01T14:07:04.980975Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980979Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 118, partNo: 0, Offset: 117 is stored on disk
2025-10-01T14:07:04.980981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 119, partNo: 0, Offset: 118 is stored on disk
2025-10-01T14:07:04.980986Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 120, partNo: 0, Offset: 119 is stored on disk
2025-10-01T14:07:04.980992Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.980995Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 121, partNo: 0, Offset: 120 is stored on disk
2025-10-01T14:07:04.980997Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.981000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 122, partNo: 0, Offset: 121 is stored on disk
2025-10-01T14:07:04.981002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.981005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 123, partNo: 0, Offset: 122 is stored on disk
2025-10-01T14:07:04.981050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.981092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.981098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (80)
2025-10-01T14:07:04.981092Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 73 EndOffset 73 newEndOffset 123 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-01T14:07:04.981098Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 73 endOffset 123
2025-10-01T14:07:04.981115Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 73, endOffset# 123, WTime# 1759327624960, sizeLag# 541088
2025-10-01T14:07:04.981117Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.981128Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 5a612d56-d716f2f2-7392d312-f37e2262, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 60, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.981119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 124 partNo 0
2025-10-01T14:07:04.981145Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 60 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 73 EndOffset 123 ClientCommitOffset 0 committedOffset 0 Guid 5a612d56-d716f2f2-7392d312-f37e2262
2025-10-01T14:07:04.981152Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 124 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 13687 count 1 nextOffset 124 batches 1
2025-10-01T14:07:04.981163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 125 partNo 0
2025-10-01T14:07:04.981167Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 125 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 27452 count 2 nextOffset 125 batches 1
2025-10-01T14:07:04.981175Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 126 partNo 0
2025-10-01T14:07:04.981178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 126 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 41327 count 3 nextOffset 126 batches 1
2025-10-01T14:07:04.981181Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 127 partNo 0
2025-10-01T14:07:04.981184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 127 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 55312 count 4 nextOffset 127 batches 1
2025-10-01T14:07:04.981187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 128 partNo 0
2025-10-01T14:07:04.981190Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 128 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 69408 count 5 nextOffset 128 batches 1
2025-10-01T14:07:04.981193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 129 partNo 0
2025-10-01T14:07:04.981196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 129 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 83614 count 6 nextOffset 129 batches 1
2025-10-01T14:07:04.981202Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 130 partNo 0
2025-10-01T14:07:04.981205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 130 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 97930 count 7 nextOffset 130 batches 1
2025-10-01T14:07:04.981217Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 131 partNo 0
2025-10-01T14:07:04.981224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 131 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 112356 count 8 nextOffset 131 batches 1
2025-10-01T14:07:04.981227Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 132 partNo 0
2025-10-01T14:07:04.981231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 132 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 126892 count 9 nextOffset 132 batches 1
2025-10-01T14:07:04.981234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 133 partNo 0
2025-10-01T14:07:04.981237Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 133 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 141538 count 10 nextOffset 133 batches 1
2025-10-01T14:07:04.981239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 134 partNo 0
2025-10-01T14:07:04.981242Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 134 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 156294 count 11 nextOffset 134 batches 1
2025-10-01T14:07:04.981245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 135 partNo 0
2025-10-01T14:07:04.981247Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 135 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 171160 count 12 nextOffset 135 batches 1
2025-10-01T14:07:04.981250Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 136 partNo 0
2025-10-01T14:07:04.981253Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 136 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 186136 count 13 nextOffset 136 batches 1
2025-10-01T14:07:04.981255Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 137 partNo 0
2025-10-01T14:07:04.981258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 137 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 201222 count 14 nextOffset 137 batches 1
2025-10-01T14:07:04.981260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 138 partNo 0
2025-10-01T14:07:04.981263Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 138 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 216418 count 15 nextOffset 138 batches 1
2025-10-01T14:07:04.981265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 139 partNo 0
2025-10-01T14:07:04.981268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 139 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 231724 count 16 nextOffset 139 batches 1
2025-10-01T14:07:04.981270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 140 partNo 0
2025-10-01T14:07:04.981274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 140 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 247140 count 17 nextOffset 140 batches 1
2025-10-01T14:07:04.981278Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 141 partNo 0
2025-10-01T14:07:04.981282Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 141 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 262666 count 18 nextOffset 141 batches 1
2025-10-01T14:07:04.981284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 142 partNo 0
2025-10-01T14:07:04.981287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 142 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 278302 count 19 nextOffset 142 batches 1
2025-10-01T14:07:04.981289Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 143 partNo 0
2025-10-01T14:07:04.981292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 143 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 294048 count 20 nextOffset 143 batches 1
2025-10-01T14:07:04.981294Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 144 partNo 0
2025-10-01T14:07:04.981297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 144 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 309904 count 21 nextOffset 144 batches 1
2025-10-01T14:07:04.981299Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 145 partNo 0
2025-10-01T14:07:04.981302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 145 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 325870 count 22 nextOffset 145 batches 1
2025-10-01T14:07:04.981307Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 146 partNo 0
2025-10-01T14:07:04.981311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 146 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 341946 count 23 nextOffset 146 batches 1
2025-10-01T14:07:04.981321Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 147 partNo 0
2025-10-01T14:07:04.981328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 147 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 358132 count 24 nextOffset 147 batches 1
2025-10-01T14:07:04.981336Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 148 partNo 0
2025-10-01T14:07:04.981340Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 148 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 374428 count 25 nextOffset 148 batches 1
2025-10-01T14:07:04.981345Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 149 partNo 0
2025-10-01T14:07:04.981352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 149 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 390834 count 26 nextOffset 149 batches 1
2025-10-01T14:07:04.981355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 150 partNo 0
2025-10-01T14:07:04.981359Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 150 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 407351 count 27 nextOffset 150 batches 1
2025-10-01T14:07:04.981362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 151 partNo 0
2025-10-01T14:07:04.981372Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 151 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 423978 count 28 nextOffset 151 batches 1
2025-10-01T14:07:04.981377Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 152 partNo 0
2025-10-01T14:07:04.981387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 152 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 440715 count 29 nextOffset 152 batches 1
2025-10-01T14:07:04.981390Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 153 partNo 0
2025-10-01T14:07:04.981393Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 153 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 457562 count 30 nextOffset 153 batches 1
2025-10-01T14:07:04.981400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 154 partNo 0
2025-10-01T14:07:04.981403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 154 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 474519 count 31 nextOffset 154 batches 1
2025-10-01T14:07:04.981406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 155 partNo 0
2025-10-01T14:07:04.981409Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 155 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 491586 count 32 nextOffset 155 batches 1
2025-10-01T14:07:04.981412Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 156 partNo 0
2025-10-01T14:07:04.981418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 156 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 508763 count 33 nextOffset 156 batches 1
2025-10-01T14:07:04.981423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 157 partNo 0
2025-10-01T14:07:04.982444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 157 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 525032 count 34 nextOffset 157 batches 1
2025-10-01T14:07:04.982471Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 158 partNo 0
2025-10-01T14:07:04.982493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 158 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 542461 count 35 nextOffset 158 batches 2
2025-10-01T14:07:04.982503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 159 partNo 0
2025-10-01T14:07:04.982506Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 159 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 559968 count 36 nextOffset 159 batches 2
2025-10-01T14:07:04.982508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 160 partNo 0
2025-10-01T14:07:04.982511Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 160 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 577585 count 37 nextOffset 160 batches 2
2025-10-01T14:07:04.982514Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 161 partNo 0
2025-10-01T14:07:04.982518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 161 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 595312 count 38 nextOffset 161 batches 2
2025-10-01T14:07:04.982521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 162 partNo 0
2025-10-01T14:07:04.982525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 162 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 613149 count 39 nextOffset 162 batches 2
2025-10-01T14:07:04.982529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 163 partNo 0
2025-10-01T14:07:04.982532Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 163 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 631096 count 40 nextOffset 163 batches 2
2025-10-01T14:07:04.982537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 164 partNo 0
2025-10-01T14:07:04.982543Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 164 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 649153 count 41 nextOffset 164 batches 2
2025-10-01T14:07:04.982548Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 165 partNo 0
2025-10-01T14:07:04.982553Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 165 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 667320 count 42 nextOffset 165 batches 2
2025-10-01T14:07:04.982558Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 166 partNo 0
2025-10-01T14:07:04.982563Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 166 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 685597 count 43 nextOffset 166 batches 2
2025-10-01T14:07:04.982569Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 167 partNo 0
2025-10-01T14:07:04.982573Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 167 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 703984 count 44 nextOffset 167 batches 2
2025-10-01T14:07:04.982576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 168 partNo 0
2025-10-01T14:07:04.982579Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 168 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 722481 count 45 nextOffset 168 batches 2
2025-10-01T14:07:04.982582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 169 partNo 0
2025-10-01T14:07:04.982585Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 169 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 741088 count 46 nextOffset 169 batches 2
2025-10-01T14:07:04.982587Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 170 partNo 0
2025-10-01T14:07:04.982591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 170 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 759805 count 47 nextOffset 170 batches 2
2025-10-01T14:07:04.982594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 171 partNo 0
2025-10-01T14:07:04.982596Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 171 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 778632 count 48 nextOffset 171 batches 2
2025-10-01T14:07:04.982599Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 172 partNo 0
2025-10-01T14:07:04.982602Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 172 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 797569 count 49 nextOffset 172 batches 2
2025-10-01T14:07:04.982605Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 173 partNo 0
2025-10-01T14:07:04.982607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 173 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 816616 count 50 nextOffset 173 batches 2
2025-10-01T14:07:04.982611Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 174 partNo 0
2025-10-01T14:07:04.982615Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 174 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 835773 count 51 nextOffset 174 batches 2
2025-10-01T14:07:04.982619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 175 partNo 0
2025-10-01T14:07:04.982621Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 175 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 855040 count 52 nextOffset 175 batches 2
2025-10-01T14:07:04.982625Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 176 partNo 0
2025-10-01T14:07:04.982627Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 176 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 874417 count 53 nextOffset 176 batches 2
2025-10-01T14:07:04.982632Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 177 partNo 0
2025-10-01T14:07:04.982636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 177 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 893904 count 54 nextOffset 177 batches 2
2025-10-01T14:07:04.982638Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 178 partNo 0
2025-10-01T14:07:04.982641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 178 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 913501 count 55 nextOffset 178 batches 2
2025-10-01T14:07:04.982643Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 179 partNo 0
2025-10-01T14:07:04.982646Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 179 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 933208 count 56 nextOffset 179 batches 2
2025-10-01T14:07:04.982648Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 180 partNo 0
2025-10-01T14:07:04.982651Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 180 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 953025 count 57 nextOffset 180 batches 2
2025-10-01T14:07:04.982654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 181 partNo 0
2025-10-01T14:07:04.982657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 181 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 972952 count 58 nextOffset 181 batches 2
2025-10-01T14:07:04.982659Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 182 partNo 0
2025-10-01T14:07:04.982661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 182 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 992989 count 59 nextOffset 182 batches 2
2025-10-01T14:07:04.982664Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 183 partNo 0
2025-10-01T14:07:04.982667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 183 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1013136 count 60 nextOffset 183 batches 2
2025-10-01T14:07:04.982669Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 184 partNo 0
2025-10-01T14:07:04.982672Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 184 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1033393 count 61 nextOffset 184 batches 2
2025-10-01T14:07:04.982676Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 185 partNo 0
2025-10-01T14:07:04.983344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 185 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1052956 count 62 nextOffset 185 batches 2
2025-10-01T14:07:04.983356Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 186 partNo 0
2025-10-01T14:07:04.983367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 186 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1073465 count 63 nextOffset 186 batches 3
2025-10-01T14:07:04.983370Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 187 partNo 0
2025-10-01T14:07:04.983375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 187 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1094052 count 64 nextOffset 187 batches 3
2025-10-01T14:07:04.983387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 188 partNo 0
2025-10-01T14:07:04.983389Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 188 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1114749 count 65 nextOffset 188 batches 3
2025-10-01T14:07:04.983391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 189 partNo 0
2025-10-01T14:07:04.983393Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 189 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1135556 count 66 nextOffset 189 batches 3
2025-10-01T14:07:04.983395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 190 partNo 0
2025-10-01T14:07:04.983398Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 190 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1156473 count 67 nextOffset 190 batches 3
2025-10-01T14:07:04.983400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 191 partNo 0
2025-10-01T14:07:04.983402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 191 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1177500 count 68 nextOffset 191 batches 3
2025-10-01T14:07:04.983404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 192 partNo 0
2025-10-01T14:07:04.983406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 192 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1198637 count 69 nextOffset 192 batches 3
2025-10-01T14:07:04.983408Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 193 partNo 0
2025-10-01T14:07:04.983411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 193 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1219884 count 70 nextOffset 193 batches 3
2025-10-01T14:07:04.983413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 194 partNo 0
2025-10-01T14:07:04.983416Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 194 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1241241 count 71 nextOffset 194 batches 3
2025-10-01T14:07:04.983418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 195 partNo 0
2025-10-01T14:07:04.983420Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 195 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1262708 count 72 nextOffset 195 batches 3
2025-10-01T14:07:04.983422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 196 partNo 0
2025-10-01T14:07:04.983423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 196 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1284285 count 73 nextOffset 196 batches 3
2025-10-01T14:07:04.983425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 197 partNo 0
2025-10-01T14:07:04.983428Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 197 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1305972 count 74 nextOffset 197 batches 3
2025-10-01T14:07:04.983431Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 198 partNo 0
2025-10-01T14:07:04.983434Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 198 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1327769 count 75 nextOffset 198 batches 3
2025-10-01T14:07:04.983437Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 199 partNo 0
2025-10-01T14:07:04.983440Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 199 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1349676 count 76 nextOffset 199 batches 3
2025-10-01T14:07:04.983442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 200 partNo 0
2025-10-01T14:07:04.983445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 200 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1371693 count 77 nextOffset 200 batches 3
2025-10-01T14:07:04.983448Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 201 partNo 0
2025-10-01T14:07:04.983451Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 201 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1393820 count 78 nextOffset 201 batches 3
2025-10-01T14:07:04.983455Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 202 partNo 0
2025-10-01T14:07:04.983459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 202 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1416057 count 79 nextOffset 202 batches 3
2025-10-01T14:07:04.983462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 203 partNo 0
2025-10-01T14:07:04.983464Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 203 partNo 0 FormedBlobsCount 0 NewHead: Offset 123 PartNo 0 PackedSize 1438404 count 80 nextOffset 203 batches 3
2025-10-01T14:07:04.983467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.983617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 123,80 HeadOffset 123 endOffset 123 curOffset 203 d0000000000_00000000000000000123_00000_0000000080_00000? size 1437910 WTime 1759327624982
2025-10-01T14:07:04.984590Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.984602Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.984605Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.984608Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:04.984610Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:04.984612Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:04.984614Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:04.984617Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 7 keys were taken away. Let's read 837472 bytes (837472)
2025-10-01T14:07:04.984620Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 7, size 837472 (8388608)
2025-10-01T14:07:04.984650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 74
2025-10-01T14:07:04.984673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 75
2025-10-01T14:07:04.984754Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 74 offsets: 73 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:04.985130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 74
2025-10-01T14:07:04.985444Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985490Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985496Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 75 offsets: 74 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:04.985998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 75
2025-10-01T14:07:04.986037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 76 offsets: 75 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:04.986040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 76
2025-10-01T14:07:04.986058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 77 offsets: 76 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:04.986061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 77
2025-10-01T14:07:04.986078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 78 offsets: 77 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:04.986081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 78
2025-10-01T14:07:04.986099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 79 offsets: 78 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.986101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 79
2025-10-01T14:07:04.984780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 76
2025-10-01T14:07:04.984788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 77
2025-10-01T14:07:04.984795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 78
2025-10-01T14:07:04.984801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 79
2025-10-01T14:07:04.984807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 80
2025-10-01T14:07:04.984813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 81
2025-10-01T14:07:04.984819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 82
2025-10-01T14:07:04.984824Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 83
2025-10-01T14:07:04.984838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 84
2025-10-01T14:07:04.984844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 85
2025-10-01T14:07:04.984849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 86
2025-10-01T14:07:04.984856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 87
2025-10-01T14:07:04.984861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 88
2025-10-01T14:07:04.984867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 89
2025-10-01T14:07:04.984876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 90
2025-10-01T14:07:04.984882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 91
2025-10-01T14:07:04.984888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 92
2025-10-01T14:07:04.984895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 93
2025-10-01T14:07:04.984900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 94
2025-10-01T14:07:04.984908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 95
2025-10-01T14:07:04.984914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 96
2025-10-01T14:07:04.984920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 97
2025-10-01T14:07:04.984926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 98
2025-10-01T14:07:04.984932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 201  requestId: <none> cookie: 99
2025-10-01T14:07:04.984938Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 202  requestId: <none> cookie: 100
2025-10-01T14:07:04.986534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 80 offsets: 79 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.984942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 203  requestId: <none> cookie: 101
2025-10-01T14:07:04.984946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 204  requestId: <none> cookie: 102
2025-10-01T14:07:04.986542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 80
2025-10-01T14:07:04.984950Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 205  requestId: <none> cookie: 103
2025-10-01T14:07:04.984954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 211  requestId: <none> cookie: 104
2025-10-01T14:07:04.984958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 212  requestId: <none> cookie: 105
2025-10-01T14:07:04.984963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 213  requestId: <none> cookie: 106
2025-10-01T14:07:04.984969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 214  requestId: <none> cookie: 107
2025-10-01T14:07:04.984975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 215  requestId: <none> cookie: 108
2025-10-01T14:07:04.984980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 221  requestId: <none> cookie: 109
2025-10-01T14:07:04.984986Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 222  requestId: <none> cookie: 110
2025-10-01T14:07:04.984992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 223  requestId: <none> cookie: 111
2025-10-01T14:07:04.984999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 224  requestId: <none> cookie: 112
2025-10-01T14:07:04.985004Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 225  requestId: <none> cookie: 113
2025-10-01T14:07:04.985010Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 231  requestId: <none> cookie: 114
2025-10-01T14:07:04.985015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 232  requestId: <none> cookie: 115
2025-10-01T14:07:04.985039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 204 partNo : 0 messageNo: 411 size 22415 offset: -1
2025-10-01T14:07:04.985062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 233  requestId: <none> cookie: 116
2025-10-01T14:07:04.985073Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 205 partNo : 0 messageNo: 412 size 22525 offset: -1
2025-10-01T14:07:04.985082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 234  requestId: <none> cookie: 117
2025-10-01T14:07:04.985096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985100Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 206 partNo : 0 messageNo: 413 size 22635 offset: -1
2025-10-01T14:07:04.986608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 81 offsets: 80 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.986620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 81
2025-10-01T14:07:04.985107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 235  requestId: <none> cookie: 118
2025-10-01T14:07:04.985120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985121Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 207 partNo : 0 messageNo: 414 size 22745 offset: -1
2025-10-01T14:07:04.985130Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 241  requestId: <none> cookie: 119
2025-10-01T14:07:04.985142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 208 partNo : 0 messageNo: 415 size 22855 offset: -1
2025-10-01T14:07:04.985151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 82 offsets: 81 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985160Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 242  requestId: <none> cookie: 120
2025-10-01T14:07:04.986660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 82
2025-10-01T14:07:04.985524Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985164Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 243  requestId: <none> cookie: 121
2025-10-01T14:07:04.985555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 83 offsets: 82 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 83
2025-10-01T14:07:04.985573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985182Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985183Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985578Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985194Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 244  requestId: <none> cookie: 122
2025-10-01T14:07:04.985590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 84 offsets: 83 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985595Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 84
2025-10-01T14:07:04.985606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 245  requestId: <none> cookie: 123
2025-10-01T14:07:04.985612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985217Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.985617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985218Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.985624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985226Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.985633Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985236Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 123 partNo 0 count 80 size 1437910
2025-10-01T14:07:04.985638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985243Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 85 offsets: 84 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.985254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 85
2025-10-01T14:07:04.985255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.985651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 86 offsets: 85 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 86
2025-10-01T14:07:04.985676Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985693Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 87 offsets: 86 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 87
2025-10-01T14:07:04.985736Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985741Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985746Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985751Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 88 offsets: 87 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.985763Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985786Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985802Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985815Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.985838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.986314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.986342Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.986348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.985256Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986354Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.985258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986360Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.985259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986409Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.985262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.985264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.985267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 88
2025-10-01T14:07:04.985318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 416  requestId: <none> cookie: 209
2025-10-01T14:07:04.985321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 417  requestId: <none> cookie: 210
2025-10-01T14:07:04.985323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 418  requestId: <none> cookie: 211
2025-10-01T14:07:04.985325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 419  requestId: <none> cookie: 212
2025-10-01T14:07:04.985327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 420  requestId: <none> cookie: 213
2025-10-01T14:07:04.985352Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 73 count 60 size 524288 endOffset 123 max time lag 0ms effective offset 73
2025-10-01T14:07:04.985362Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 541088 count 50 last offset 73, current partition end offset: 123
2025-10-01T14:07:04.985366Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-01T14:07:04.985375Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 73 partno 0 count 50 parts_count 0 source 1 size 541088 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.985378Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-01T14:07:04.985387Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.985441Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 73 partno 0 count 50 parts 0 suffix '63'
2025-10-01T14:07:04.986003Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 73 totakecount 50 count 48 size 514056 from pos 0 cbcount 48
2025-10-01T14:07:04.986062Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 121 totakecount 50 count 2 size 26988 from pos 0 cbcount 2
2025-10-01T14:07:04.986110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 73
2025-10-01T14:07:04.986239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 209 partNo : 0 messageNo: 421 size 22965 offset: -1
2025-10-01T14:07:04.986271Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 210 partNo : 0 messageNo: 422 size 23075 offset: -1
2025-10-01T14:07:04.986303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 89 offsets: 88 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 4 }
2025-10-01T14:07:04.986310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 211 partNo : 0 messageNo: 423 size 23185 offset: -1
2025-10-01T14:07:04.986333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 89
2025-10-01T14:07:04.986335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 212 partNo : 0 messageNo: 424 size 23295 offset: -1
2025-10-01T14:07:04.986381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986387Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 213 partNo : 0 messageNo: 425 size 23405 offset: -1
2025-10-01T14:07:04.986392Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 90 offsets: 89 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 4 }
2025-10-01T14:07:04.986950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 90
2025-10-01T14:07:04.986407Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986410Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.986415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.986749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986760Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.986782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.986790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 426  requestId: <none> cookie: 214
2025-10-01T14:07:04.986802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 427  requestId: <none> cookie: 215
2025-10-01T14:07:04.986804Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 428  requestId: <none> cookie: 216
2025-10-01T14:07:04.986806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 429  requestId: <none> cookie: 217
2025-10-01T14:07:04.986809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 430  requestId: <none> cookie: 218
2025-10-01T14:07:04.986996Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.987013Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.987026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.987036Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.987040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.987047Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.987240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 214 partNo : 0 messageNo: 431 size 23515 offset: -1
2025-10-01T14:07:04.987294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987299Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 215 partNo : 0 messageNo: 432 size 23625 offset: -1
2025-10-01T14:07:04.987315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987317Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 216 partNo : 0 messageNo: 433 size 23735 offset: -1
2025-10-01T14:07:04.987335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 217 partNo : 0 messageNo: 434 size 23845 offset: -1
2025-10-01T14:07:04.987363Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987368Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 218 partNo : 0 messageNo: 435 size 23955 offset: -1
2025-10-01T14:07:04.987377Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.987383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.987389Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.987391Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.987396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.987402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.987405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.987429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.987431Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.987433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.987435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.987437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.987449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 436  requestId: <none> cookie: 219
2025-10-01T14:07:04.987465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 437  requestId: <none> cookie: 220
2025-10-01T14:07:04.987471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 438  requestId: <none> cookie: 221
2025-10-01T14:07:04.987473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 439  requestId: <none> cookie: 222
2025-10-01T14:07:04.987476Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 440  requestId: <none> cookie: 223
2025-10-01T14:07:04.988395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 91 offsets: 90 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 4 }
2025-10-01T14:07:04.988404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 91
2025-10-01T14:07:04.988447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 92 offsets: 91 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 4 }
2025-10-01T14:07:04.988450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 92
2025-10-01T14:07:04.988472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 93 offsets: 92 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 4 }
2025-10-01T14:07:04.988476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 93
2025-10-01T14:07:04.988493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 94 offsets: 93 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 94
2025-10-01T14:07:04.988515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 95 offsets: 94 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 95
2025-10-01T14:07:04.988535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 96 offsets: 95 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 96
2025-10-01T14:07:04.988557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 97 offsets: 96 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 97
2025-10-01T14:07:04.988580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 98 offsets: 97 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 98
2025-10-01T14:07:04.988604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 99 offsets: 98 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 99
2025-10-01T14:07:04.988626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 100 offsets: 99 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 100
2025-10-01T14:07:04.988646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 101 offsets: 100 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 101
2025-10-01T14:07:04.988666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 102 offsets: 101 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 102
2025-10-01T14:07:04.988686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 103 offsets: 102 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:04.988688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 103
2025-10-01T14:07:04.988706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 104 offsets: 103 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.988710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 104
2025-10-01T14:07:04.988727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 105 offsets: 104 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.988730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 105
2025-10-01T14:07:04.988748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 106 offsets: 105 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.988750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 106
2025-10-01T14:07:04.988767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 107 offsets: 106 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.988771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 107
2025-10-01T14:07:04.988788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 108 offsets: 107 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.988791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 108
2025-10-01T14:07:04.988826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 109 offsets: 108 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.988841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 109
2025-10-01T14:07:04.988860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 110 offsets: 109 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.988863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 110
2025-10-01T14:07:04.988881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 111 offsets: 110 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.988883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 111
2025-10-01T14:07:04.988901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 112 offsets: 111 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.988903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 112
2025-10-01T14:07:04.988924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 113 offsets: 112 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.988927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 113
2025-10-01T14:07:04.988976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 114 offsets: 113 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.988985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 114
2025-10-01T14:07:04.989028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 115 offsets: 114 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.989031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 115
2025-10-01T14:07:04.989073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 116 offsets: 115 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.989076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 116
2025-10-01T14:07:04.989098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 117 offsets: 116 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.989100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 117
2025-10-01T14:07:04.987226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.987240Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.987246Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.987251Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.987256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.987803Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 123 Result { Offset: 73 Data: "... 8113 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624949 UncompressedSize: 8041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 8223 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624949 UncompressedSize: 8151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 8333 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624949 UncompressedSize: 8261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 8443 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624949 UncompressedSize: 8371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 8553 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624951 UncompressedSize: 8481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 8663 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624951 UncompressedSize: 8591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 8773 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624951 UncompressedSize: 8701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 8883 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624951 UncompressedSize: 8811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 8993 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624951 UncompressedSize: 8921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 9103 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 9213 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 9323 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 9433 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 9543 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 9653 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 9763 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 9873 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 9983 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 9911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 10093 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 10021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 10203 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 10131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 10313 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624952 UncompressedSize: 10241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 10423 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 10351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 10533 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 10461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 10643 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 10571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 10753 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 10681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 10863 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 10791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 10973 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 10901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 100 Data: "... 11083 bytes ..." SourceId: "\000src_id" SeqNo: 101 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 101 Data: "... 11193 bytes ..." SourceId: "\000src_id" SeqNo: 102 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 102 Data: "... 11303 bytes ..." SourceId: "\000src_id" SeqNo: 103 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 103 Data: "... 11413 bytes ..." SourceId: "\000src_id" SeqNo: 104 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 104 Data: "... 11523 bytes ..." SourceId: "\000src_id" SeqNo: 105 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 105 Data: "... 11633 bytes ..." SourceId: "\000src_id" SeqNo: 106 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 106 Data: "... 11743 bytes ..." SourceId: "\000src_id" SeqNo: 107 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 107 Data: "... 11853 bytes ..." SourceId: "\000src_id" SeqNo: 108 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 108 Data: "... 11963 bytes ..." SourceId: "\000src_id" SeqNo: 109 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 11891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 109 Data: "... 12073 bytes ..." SourceId: "\000src_id" SeqNo: 110 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 12001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 110 Data: "... 12183 bytes ..." SourceId: "\000src_id" SeqNo: 111 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 12111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 111 Data: "... 12293 bytes ..." SourceId: "\000src_id" SeqNo: 112 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 12221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 112 Data: "... 12403 bytes ..." SourceId: "\000src_id" SeqNo: 113 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624953 UncompressedSize: 12331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 113 Data: "... 12513 bytes ..." SourceId: "\000src_id" SeqNo: 114 WriteTimestampMS: 1759327624968 CreateTimestampMS: 1759327624954 UncompressedSize: 12441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 114 Data: "... 12623 bytes ..." SourceId: "\000src_id" SeqNo: 115 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 12551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 115 Data: "... 12733 bytes ..." SourceId: "\000src_id" SeqNo: 116 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 12661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 116 Data: "... 12843 bytes ..." SourceId: "\000src_id" SeqNo: 117 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 12771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 117 Data: "... 12953 bytes ..." SourceId: "\000src_id" SeqNo: 118 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 12881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 118 Data: "... 13063 bytes ..." SourceId: "\000src_id" SeqNo: 119 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 12991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 119 Data: "... 13173 bytes ..." SourceId: "\000src_id" SeqNo: 120 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 13101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 120 Data: "... 13283 bytes ..." SourceId: "\000src_id" SeqNo: 121 WriteTimestampMS: 1759327624969 CreateTimestampMS: 1759327624954 UncompressedSize: 13211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 121 Data: "... 13393 bytes ..." SourceId: "\000src_id" SeqNo: 122 WriteTimestampMS: 1759327624970 CreateTimestampMS: 1759327624954 UncompressedSize: 13321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 122 Data: "... 13503 bytes ..." SourceId: "\000src_id" SeqNo: 123 WriteTimestampMS: 1759327624970 CreateTimestampMS: 1759327624955 UncompressedSize: 13431 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550204 RealReadOffset: 122 WaitQuotaTimeMs: 0 EndOffset: 123 StartOffset: 0 } Cookie: 73 }
2025-10-01T14:07:04.988048Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 123
2025-10-01T14:07:04.988058Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 123 ReadOffset 123 ReadGuid 5a612d56-d716f2f2-7392d312-f37e2262 has messages 1
2025-10-01T14:07:04.988244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.988255Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.988260Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.988264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.989749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 118 offsets: 117 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.989768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 118
2025-10-01T14:07:04.988269Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.988352Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.988361Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.988366Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.988371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.988376Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.988432Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 5a612d56-d716f2f2-7392d312-f37e2262, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 538921
2025-10-01T14:07:04.988445Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 5a612d56-d716f2f2-7392d312-f37e2262
2025-10-01T14:07:04.989203Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.989649Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.989784Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.989879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 119 offsets: 118 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:04.989888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 119
2025-10-01T14:07:04.989891Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 538921, now ReadSizeBudget = 0, ReadSizeServerDelta = -14633
2025-10-01T14:07:04.989900Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.989912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.989930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.989945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 219 partNo : 0 messageNo: 441 size 24065 offset: -1
2025-10-01T14:07:04.989994Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (73-122)
2025-10-01T14:07:04.989981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.989987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990004Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 538921 to budget
2025-10-01T14:07:04.989991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 220 partNo : 0 messageNo: 442 size 24175 offset: -1
2025-10-01T14:07:04.990006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990010Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 538921, ReadSizeServerDelta = -14633
2025-10-01T14:07:04.990008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 221 partNo : 0 messageNo: 443 size 24285 offset: -1
2025-10-01T14:07:04.990028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990017Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 222 partNo : 0 messageNo: 444 size 24395 offset: -1
2025-10-01T14:07:04.990051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 223 partNo : 0 messageNo: 445 size 24505 offset: -1
2025-10-01T14:07:04.990062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990064Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.990064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990084Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (73-73)
2025-10-01T14:07:04.990085Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990100Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (74-74)
2025-10-01T14:07:04.990102Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990111Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.990117Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (75-75)
2025-10-01T14:07:04.990125Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (76-76)
2025-10-01T14:07:04.990121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.990126Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.990130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.990132Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.990134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.990136Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.990111Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.990140Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.990142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.990162Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (77-77)
2025-10-01T14:07:04.990155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 446  requestId: <none> cookie: 224
2025-10-01T14:07:04.990165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 447  requestId: <none> cookie: 225
2025-10-01T14:07:04.990168Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 448  requestId: <none> cookie: 226
2025-10-01T14:07:04.990171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 449  requestId: <none> cookie: 227
2025-10-01T14:07:04.990174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 450  requestId: <none> cookie: 228
2025-10-01T14:07:04.990170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (78-78)
2025-10-01T14:07:04.990202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990212Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (79-79)
2025-10-01T14:07:04.990220Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990231Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990235Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990237Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (80-80)
2025-10-01T14:07:04.990239Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990299Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 123 count 80 size 1437910 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.990313Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (81-81)
2025-10-01T14:07:04.990317Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (82-82)
2025-10-01T14:07:04.990313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.990321Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (83-83)
2025-10-01T14:07:04.990326Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (84-84)
2025-10-01T14:07:04.990335Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (85-85)
2025-10-01T14:07:04.990327Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 123 partno 0 count 80 parts 0 suffix '63' size 1437910
2025-10-01T14:07:04.990330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1437330 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.990347Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (86-86)
2025-10-01T14:07:04.990338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990347Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 124, partNo: 0, Offset: 123 is stored on disk
2025-10-01T14:07:04.990351Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990354Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 125, partNo: 0, Offset: 124 is stored on disk
2025-10-01T14:07:04.990357Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (87-87)
2025-10-01T14:07:04.990356Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990359Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 126, partNo: 0, Offset: 125 is stored on disk
2025-10-01T14:07:04.990361Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990363Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 127, partNo: 0, Offset: 126 is stored on disk
2025-10-01T14:07:04.990365Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 128, partNo: 0, Offset: 127 is stored on disk
2025-10-01T14:07:04.990380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990383Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 129, partNo: 0, Offset: 128 is stored on disk
2025-10-01T14:07:04.990392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (88-88)
2025-10-01T14:07:04.990385Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990389Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 130, partNo: 0, Offset: 129 is stored on disk
2025-10-01T14:07:04.990391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 131, partNo: 0, Offset: 130 is stored on disk
2025-10-01T14:07:04.990397Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 132, partNo: 0, Offset: 131 is stored on disk
2025-10-01T14:07:04.990402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 133, partNo: 0, Offset: 132 is stored on disk
2025-10-01T14:07:04.990408Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990412Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 134, partNo: 0, Offset: 133 is stored on disk
2025-10-01T14:07:04.990406Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990415Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 135, partNo: 0, Offset: 134 is stored on disk
2025-10-01T14:07:04.990420Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990424Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 136, partNo: 0, Offset: 135 is stored on disk
2025-10-01T14:07:04.990425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990428Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 137, partNo: 0, Offset: 136 is stored on disk
2025-10-01T14:07:04.990430Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990426Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 138, partNo: 0, Offset: 137 is stored on disk
2025-10-01T14:07:04.990435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990438Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 139, partNo: 0, Offset: 138 is stored on disk
2025-10-01T14:07:04.990443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990440Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990443Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 140, partNo: 0, Offset: 139 is stored on disk
2025-10-01T14:07:04.990445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990448Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 141, partNo: 0, Offset: 140 is stored on disk
2025-10-01T14:07:04.990450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 142, partNo: 0, Offset: 141 is stored on disk
2025-10-01T14:07:04.990456Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 143, partNo: 0, Offset: 142 is stored on disk
2025-10-01T14:07:04.990461Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990464Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 144, partNo: 0, Offset: 143 is stored on disk
2025-10-01T14:07:04.990466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990469Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 145, partNo: 0, Offset: 144 is stored on disk
2025-10-01T14:07:04.990472Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990475Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 146, partNo: 0, Offset: 145 is stored on disk
2025-10-01T14:07:04.990478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990481Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 147, partNo: 0, Offset: 146 is stored on disk
2025-10-01T14:07:04.990482Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990486Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 148, partNo: 0, Offset: 147 is stored on disk
2025-10-01T14:07:04.990488Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990491Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 149, partNo: 0, Offset: 148 is stored on disk
2025-10-01T14:07:04.990493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990497Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 150, partNo: 0, Offset: 149 is stored on disk
2025-10-01T14:07:04.990499Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990502Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 151, partNo: 0, Offset: 150 is stored on disk
2025-10-01T14:07:04.990507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990509Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (89-89)
2025-10-01T14:07:04.990511Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 152, partNo: 0, Offset: 151 is stored on disk
2025-10-01T14:07:04.990513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (90-90)
2025-10-01T14:07:04.990516Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 153, partNo: 0, Offset: 152 is stored on disk
2025-10-01T14:07:04.990520Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (91-91)
2025-10-01T14:07:04.990518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990522Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 154, partNo: 0, Offset: 153 is stored on disk
2025-10-01T14:07:04.990529Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (92-92)
2025-10-01T14:07:04.990524Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990527Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 155, partNo: 0, Offset: 154 is stored on disk
2025-10-01T14:07:04.990540Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (93-93)
2025-10-01T14:07:04.990529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990533Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 156, partNo: 0, Offset: 155 is stored on disk
2025-10-01T14:07:04.990535Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990538Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 157, partNo: 0, Offset: 156 is stored on disk
2025-10-01T14:07:04.990539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990544Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 158, partNo: 0, Offset: 157 is stored on disk
2025-10-01T14:07:04.990550Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (94-94)
2025-10-01T14:07:04.990546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990548Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 159, partNo: 0, Offset: 158 is stored on disk
2025-10-01T14:07:04.990469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990550Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990553Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 160, partNo: 0, Offset: 159 is stored on disk
2025-10-01T14:07:04.990557Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990560Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 161, partNo: 0, Offset: 160 is stored on disk
2025-10-01T14:07:04.990575Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (95-95)
2025-10-01T14:07:04.990562Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 162, partNo: 0, Offset: 161 is stored on disk
2025-10-01T14:07:04.990567Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 163, partNo: 0, Offset: 162 is stored on disk
2025-10-01T14:07:04.990585Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 23} (96-96)
2025-10-01T14:07:04.990572Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990575Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 164, partNo: 0, Offset: 163 is stored on disk
2025-10-01T14:07:04.990577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990580Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 165, partNo: 0, Offset: 164 is stored on disk
2025-10-01T14:07:04.990595Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 24} (97-97)
2025-10-01T14:07:04.990582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990586Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 166, partNo: 0, Offset: 165 is stored on disk
2025-10-01T14:07:04.990588Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990609Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 25} (98-98)
2025-10-01T14:07:04.990592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 167, partNo: 0, Offset: 166 is stored on disk
2025-10-01T14:07:04.990594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990606Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 168, partNo: 0, Offset: 167 is stored on disk
2025-10-01T14:07:04.990609Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 169, partNo: 0, Offset: 168 is stored on disk
2025-10-01T14:07:04.990614Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990621Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 26} (99-99)
2025-10-01T14:07:04.990617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 170, partNo: 0, Offset: 169 is stored on disk
2025-10-01T14:07:05.044255Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 27} (100-100)
2025-10-01T14:07:05.044268Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 28} (101-101)
2025-10-01T14:07:05.044275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 29} (102-102)
2025-10-01T14:07:05.044284Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 30} (103-103)
2025-10-01T14:07:05.044294Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 31} (104-104)
2025-10-01T14:07:05.044427Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 32} (105-105)
2025-10-01T14:07:05.044437Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 33} (106-106)
2025-10-01T14:07:05.044445Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 34} (107-107)
2025-10-01T14:07:05.044452Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 35} (108-108)
2025-10-01T14:07:05.044469Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 36} (109-109)
2025-10-01T14:07:05.044475Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 37} (110-110)
2025-10-01T14:07:05.044482Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 38} (111-111)
2025-10-01T14:07:04.990620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.044489Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 39} (112-112)
2025-10-01T14:07:04.990623Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 171, partNo: 0, Offset: 170 is stored on disk
2025-10-01T14:07:04.990625Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.044497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 40} (113-113)
2025-10-01T14:07:04.990628Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 172, partNo: 0, Offset: 171 is stored on disk
2025-10-01T14:07:05.044505Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (114-114)
2025-10-01T14:07:05.044513Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (115-115)
2025-10-01T14:07:04.990630Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 173, partNo: 0, Offset: 172 is stored on disk
2025-10-01T14:07:05.044519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (116-116)
2025-10-01T14:07:05.044533Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (117-117)
2025-10-01T14:07:04.990914Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 123 EndOffset 123 newEndOffset 203 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-01T14:07:04.990885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 120 offsets: 119 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.044541Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (118-118)
2025-10-01T14:07:05.044577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 120
2025-10-01T14:07:05.044591Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (119-119)
2025-10-01T14:07:05.044599Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (120-120)
2025-10-01T14:07:05.044606Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (121-121)
2025-10-01T14:07:05.044615Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (122-122)
2025-10-01T14:07:04.990635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990638Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 174, partNo: 0, Offset: 173 is stored on disk
2025-10-01T14:07:04.990640Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990642Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 175, partNo: 0, Offset: 174 is stored on disk
2025-10-01T14:07:04.990644Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 176, partNo: 0, Offset: 175 is stored on disk
2025-10-01T14:07:04.990649Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990924Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 123 endOffset 203
2025-10-01T14:07:04.990652Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 177, partNo: 0, Offset: 176 is stored on disk
2025-10-01T14:07:04.990654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990656Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 178, partNo: 0, Offset: 177 is stored on disk
2025-10-01T14:07:04.990658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990935Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 123, endOffset# 203, WTime# 1759327624970, sizeLag# 1437910
2025-10-01T14:07:04.990660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 179, partNo: 0, Offset: 178 is stored on disk
2025-10-01T14:07:04.990938Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:04.990662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990664Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 180, partNo: 0, Offset: 179 is stored on disk
2025-10-01T14:07:04.990666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.991504Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990669Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 181, partNo: 0, Offset: 180 is stored on disk
2025-10-01T14:07:04.991517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.991522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 182, partNo: 0, Offset: 181 is stored on disk
2025-10-01T14:07:04.990675Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990678Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 183, partNo: 0, Offset: 182 is stored on disk
2025-10-01T14:07:04.991527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991531Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991545Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991650Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991659Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991662Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991677Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991708Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991721Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991725Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991729Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.044754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 121 offsets: 120 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.044766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 121
2025-10-01T14:07:04.991733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991781Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991799Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.044793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 122 offsets: 121 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:04.990680Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990682Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 184, partNo: 0, Offset: 183 is stored on disk
2025-10-01T14:07:04.990684Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990686Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 185, partNo: 0, Offset: 184 is stored on disk
2025-10-01T14:07:04.990688Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990690Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 186, partNo: 0, Offset: 185 is stored on disk
2025-10-01T14:07:04.990692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 187, partNo: 0, Offset: 186 is stored on disk
2025-10-01T14:07:04.990696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990700Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 188, partNo: 0, Offset: 187 is stored on disk
2025-10-01T14:07:04.990702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990706Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 189, partNo: 0, Offset: 188 is stored on disk
2025-10-01T14:07:04.990707Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990712Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 190, partNo: 0, Offset: 189 is stored on disk
2025-10-01T14:07:04.990714Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.000447Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 1434364, now ReadSizeBudget = 0, ReadSizeServerDelta = -910076
2025-10-01T14:07:04.991814Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991819Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991826Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991850Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991856Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991870Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991883Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991892Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991897Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991910Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991915Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991935Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991939Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991944Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991950Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991955Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991968Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.991994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992006Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992009Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992020Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992039Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992146Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992159Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992163Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992199Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.044800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 122
2025-10-01T14:07:04.992285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992288Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.992460Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.992467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.992470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.045081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 123 offsets: 122 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.045090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 123
2025-10-01T14:07:04.992473Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.992476Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.993062Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 538921 } }
2025-10-01T14:07:04.993080Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.045108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 124 offsets: 123 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 9 }
2025-10-01T14:07:04.993085Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# cc4debb2-8a534d9b-4ee3e983-711db57e
2025-10-01T14:07:05.045111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 124
2025-10-01T14:07:04.993099Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 95ac45a1-bf3e89f0-f03cc989-ccf322ad, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 96, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.993113Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 96 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 123 EndOffset 203 ClientCommitOffset 0 committedOffset 0 Guid 95ac45a1-bf3e89f0-f03cc989-ccf322ad
>>> event from dataHandler: 2025-10-01T14:07:05.045134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 125 offsets: 124 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 9 }
2025-10-01T14:07:05.045137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 125
2025-10-01T14:07:04.993256Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.993429Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.993488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.045152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 126 offsets: 125 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 9 }
2025-10-01T14:07:05.045160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 126
2025-10-01T14:07:04.993500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.993504Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.993508Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.993512Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.993612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.993620Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.993623Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.045185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 127 offsets: 126 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 9 }
2025-10-01T14:07:05.045193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 127
2025-10-01T14:07:04.993628Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.993633Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.993638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.993727Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.045209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 128 offsets: 127 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 9 }
2025-10-01T14:07:04.993797Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.045213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 128
2025-10-01T14:07:04.993902Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.994036Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.994074Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.994114Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.045234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 129 offsets: 128 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 8 }
2025-10-01T14:07:05.045248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 129
2025-10-01T14:07:04.994274Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.994343Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.994678Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.045264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 130 offsets: 129 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 8 }
2025-10-01T14:07:05.045271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 130
2025-10-01T14:07:04.995546Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.996019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.996040Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.996044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.045287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 131 offsets: 130 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 8 }
2025-10-01T14:07:04.996049Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.045291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 131
2025-10-01T14:07:04.996129Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.996135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.996266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.996311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.996317Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.045309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 132 offsets: 131 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 8 }
2025-10-01T14:07:04.996327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.045312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 132
2025-10-01T14:07:04.996333Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.996394Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.996478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.996707Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.045327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 133 offsets: 132 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 8 }
2025-10-01T14:07:04.996786Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.045330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 133
2025-10-01T14:07:04.996795Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.996801Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.996804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..8041 bytes.. Information: { Offset: 73 ProducerId: "src_id" SeqNo: 74 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8151 bytes.. Information: { Offset: 74 ProducerId: "src_id" SeqNo: 75 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8261 bytes.. Information: { Offset: 75 ProducerId: "src_id" SeqNo: 76 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8371 bytes.. Information: { Offset: 76 ProducerId: "src_id" SeqNo: 77 CreateTime: 2025-10-01T14:07:04.949000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8481 bytes.. Information: { Offset: 77 ProducerId: "src_id" SeqNo: 78 CreateTime: 2025-10-01T14:07:04.951000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8591 bytes.. Information: { Offset: 78 ProducerId: "src_id" SeqNo: 79 CreateTime: 2025-10-01T14:07:04.951000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8701 bytes.. Information: { Offset: 79 ProducerId: "src_id" SeqNo: 80 CreateTime: 2025-10-01T14:07:04.951000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8811 bytes.. Information: { Offset: 80 ProducerId: "src_id" SeqNo: 81 CreateTime: 2025-10-01T14:07:04.951000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8921 bytes.. Information: { Offset: 81 ProducerId: "src_id" SeqNo: 82 CreateTime: 2025-10-01T14:07:04.951000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9031 bytes.. Information: { Offset: 82 ProducerId: "src_id" SeqNo: 83 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9141 bytes.. Information: { Offset: 83 ProducerId: "src_id" SeqNo: 84 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9251 bytes.. Information: { Offset: 84 ProducerId: "src_id" SeqNo: 85 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9361 bytes.. Information: { Offset: 85 ProducerId: "src_id" SeqNo: 86 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9471 bytes.. Information: { Offset: 86 ProducerId: "src_id" SeqNo: 87 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9581 bytes.. Information: { Offset: 87 ProducerId: "src_id" SeqNo: 88 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9691 bytes.. Information: { Offset: 88 ProducerId: "src_id" SeqNo: 89 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9801 bytes.. Information: { Offset: 89 ProducerId: "src_id" SeqNo: 90 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9911 bytes.. Information: { Offset: 90 ProducerId: "src_id" SeqNo: 91 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10021 bytes.. Information: { Offset: 91 ProducerId: "src_id" SeqNo: 92 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10131 bytes.. Information: { Offset: 92 ProducerId: "src_id" SeqNo: 93 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10241 bytes.. Information: { Offset: 93 ProducerId: "src_id" SeqNo: 94 CreateTime: 2025-10-01T14:07:04.952000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10351 bytes.. Information: { Offset: 94 ProducerId: "src_id" SeqNo: 95 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10461 bytes.. Information: { Offset: 95 ProducerId: "src_id" SeqNo: 96 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10571 bytes.. Information: { Offset: 96 ProducerId: "src_id" SeqNo: 97 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10681 bytes.. Information: { Offset: 97 ProducerId: "src_id" SeqNo: 98 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10791 bytes.. Information: { Offset: 98 ProducerId: "src_id" SeqNo: 99 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10901 bytes.. Information: { Offset: 99 ProducerId: "src_id" SeqNo: 100 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11011 bytes.. Information: { Offset: 100 ProducerId: "src_id" SeqNo: 101 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11121 bytes.. Information: { Offset: 101 ProducerId: "src_id" SeqNo: 102 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11231 bytes.. Information: { Offset: 102 ProducerId: "src_id" SeqNo: 103 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11341 bytes.. Information: { Offset: 103 ProducerId: "src_id" SeqNo: 104 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11451 bytes.. Information: { Offset: 104 ProducerId: "src_id" SeqNo: 105 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11561 bytes.. Information: { Offset: 105 ProducerId: "src_id" SeqNo: 106 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11671 bytes.. Information: { Offset: 106 ProducerId: "src_id" SeqNo: 107 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11781 bytes.. Information: { Offset: 107 ProducerId: "src_id" SeqNo: 108 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11891 bytes.. Information: { Offset: 108 ProducerId: "src_id" SeqNo: 109 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12001 bytes.. Information: { Offset: 109 ProducerId: "src_id" SeqNo: 110 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12111 bytes.. Information: { Offset: 110 ProducerId: "src_id" SeqNo: 111 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12221 bytes.. Information: { Offset: 111 ProducerId: "src_id" SeqNo: 112 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12331 bytes.. Information: { Offset: 112 ProducerId: "src_id" SeqNo: 113 CreateTime: 2025-10-01T14:07:04.953000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12441 bytes.. Information: { Offset: 113 ProducerId: "src_id" SeqNo: 114 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.968000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12551 bytes.. Information: { Offset: 114 ProducerId: "src_id" SeqNo: 115 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12661 bytes.. Information: { Offset: 115 ProducerId: "src_id" SeqNo: 116 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12771 bytes.. Information: { Offset: 116 ProducerId: "src_id" SeqNo: 117 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12881 bytes.. Information: { Offset: 117 ProducerId: "src_id" SeqNo: 118 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12991 bytes.. Information: { Offset: 118 ProducerId: "src_id" SeqNo: 119 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13101 bytes.. Information: { Offset: 119 ProducerId: "src_id" SeqNo: 120 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13211 bytes.. Information: { Offset: 120 ProducerId: "src_id" SeqNo: 121 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.969000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13321 bytes.. Information: { Offset: 121 ProducerId: "src_id" SeqNo: 122 CreateTime: 2025-10-01T14:07:04.954000Z WriteTime: 2025-10-01T14:07:04.970000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13431 bytes.. Information: { Offset: 122 ProducerId: "src_id" SeqNo: 123 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.970000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.049331Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 50, size 536800 bytes
2025-10-01T14:07:05.049370Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.049401Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (123-157)
2025-10-01T14:07:05.049417Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 1434364 to budget
2025-10-01T14:07:05.049435Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (123-123)
2025-10-01T14:07:05.049444Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (124-124)
2025-10-01T14:07:05.049452Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (125-125)
2025-10-01T14:07:05.049457Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (126-126)
2025-10-01T14:07:05.049467Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (127-127)
2025-10-01T14:07:05.049472Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (128-128)
2025-10-01T14:07:05.049476Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (129-129)
2025-10-01T14:07:05.049481Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (130-130)
2025-10-01T14:07:05.049509Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (131-131)
2025-10-01T14:07:05.049516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (132-132)
2025-10-01T14:07:04.996809Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.049522Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (133-133)
2025-10-01T14:07:05.045346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 134 offsets: 133 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:05.049542Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (134-134)
2025-10-01T14:07:05.049548Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (135-135)
2025-10-01T14:07:05.049556Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (136-136)
2025-10-01T14:07:04.996815Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.049558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 134
2025-10-01T14:07:05.049562Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (137-137)
2025-10-01T14:07:05.049569Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (138-138)
2025-10-01T14:07:04.996998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.997006Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.997012Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.997018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.997023Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.997044Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997151Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997238Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997341Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997403Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997449Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997510Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.997748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.049610Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (139-139)
2025-10-01T14:07:04.997761Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997767Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.049617Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (140-140)
2025-10-01T14:07:04.997771Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.049624Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (141-141)
2025-10-01T14:07:05.049637Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (142-142)
2025-10-01T14:07:05.049642Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (143-143)
2025-10-01T14:07:05.049646Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (144-144)
2025-10-01T14:07:05.049651Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (145-145)
2025-10-01T14:07:05.049656Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 23} (146-146)
2025-10-01T14:07:05.049661Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 24} (147-147)
2025-10-01T14:07:05.049666Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 25} (148-148)
2025-10-01T14:07:05.049672Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 26} (149-149)
2025-10-01T14:07:05.049678Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 27} (150-150)
2025-10-01T14:07:05.049684Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 28} (151-151)
2025-10-01T14:07:05.049690Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 29} (152-152)
2025-10-01T14:07:05.049696Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 30} (153-153)
2025-10-01T14:07:05.049700Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 31} (154-154)
2025-10-01T14:07:05.049709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 135 offsets: 134 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:05.049714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 135
2025-10-01T14:07:05.049733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 136 offsets: 135 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:05.049737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 136
2025-10-01T14:07:05.049754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 137 offsets: 136 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:05.049756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 137
2025-10-01T14:07:05.049771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 138 offsets: 137 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:05.049773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 138
2025-10-01T14:07:05.049773Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 32} (155-155)
2025-10-01T14:07:05.049781Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 33} (156-156)
2025-10-01T14:07:05.049786Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (157-157)
2025-10-01T14:07:05.049789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 139 offsets: 138 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.049792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 139
2025-10-01T14:07:05.049806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 140 offsets: 139 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.049820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 140
2025-10-01T14:07:04.997776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.049836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 141 offsets: 140 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.997780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997802Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.049857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 141
2025-10-01T14:07:04.997807Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997821Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 203 Result { Offset: 123 Data: "... 13613 bytes ..." SourceId: "\000src_id" SeqNo: 124 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 13541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 124 Data: "... 13723 bytes ..." SourceId: "\000src_id" SeqNo: 125 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 13651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 125 Data: "... 13833 bytes ..." SourceId: "\000src_id" SeqNo: 126 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 13761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 126 Data: "... 13943 bytes ..." SourceId: "\000src_id" SeqNo: 127 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 13871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 127 Data: "... 14054 bytes ..." SourceId: "\000src_id" SeqNo: 128 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 13981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 128 Data: "... 14164 bytes ..." SourceId: "\000src_id" SeqNo: 129 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 129 Data: "... 14274 bytes ..." SourceId: "\000src_id" SeqNo: 130 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 130 Data: "... 14384 bytes ..." SourceId: "\000src_id" SeqNo: 131 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 131 Data: "... 14494 bytes ..." SourceId: "\000src_id" SeqNo: 132 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 132 Data: "... 14604 bytes ..." SourceId: "\000src_id" SeqNo: 133 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 133 Data: "... 14714 bytes ..." SourceId: "\000src_id" SeqNo: 134 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 134 Data: "... 14824 bytes ..." SourceId: "\000src_id" SeqNo: 135 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624955 UncompressedSize: 14751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 135 Data: "... 14934 bytes ..." SourceId: "\000src_id" SeqNo: 136 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 14861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 136 Data: "... 15044 bytes ..." SourceId: "\000src_id" SeqNo: 137 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 14971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 137 Data: "... 15154 bytes ..." SourceId: "\000src_id" SeqNo: 138 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 138 Data: "... 15264 bytes ..." SourceId: "\000src_id" SeqNo: 139 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 139 Data: "... 15374 bytes ..." SourceId: "\000src_id" SeqNo: 140 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 140 Data: "... 15484 bytes ..." SourceId: "\000src_id" SeqNo: 141 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 141 Data: "... 15594 bytes ..." SourceId: "\000src_id" SeqNo: 142 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 142 Data: "... 15704 bytes ..." SourceId: "\000src_id" SeqNo: 143 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 143 Data: "... 15814 bytes ..." SourceId: "\000src_id" SeqNo: 144 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 144 Data: "... 15924 bytes ..." SourceId: "\000src_id" SeqNo: 145 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 145 Data: "... 16034 bytes ..." SourceId: "\000src_id" SeqNo: 146 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 15961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 146 Data: "... 16144 bytes ..." SourceId: "\000src_id" SeqNo: 147 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 16071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 147 Data: "... 16254 bytes ..." SourceId: "\000src_id" SeqNo: 148 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 16181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 148 Data: "... 16364 bytes ..." SourceId: "\000src_id" SeqNo: 149 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624956 UncompressedSize: 16291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 149 Data: "... 16475 bytes ..." SourceId: "\000src_id" SeqNo: 150 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 16401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 150 Data: "... 16585 bytes ..." SourceId: "\000src_id" SeqNo: 151 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 16511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 151 Data: "... 16695 bytes ..." SourceId: "\000src_id" SeqNo: 152 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 16621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 152 Data: "... 16805 bytes ..." SourceId: "\000src_id" SeqNo: 153 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 16731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 153 Data: "... 16915 bytes ..." SourceId: "\000src_id" SeqNo: 154 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 16841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 154 Data: "... 17025 bytes ..." SourceId: "\000src_id" SeqNo: 155 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 16951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 155 Data: "... 17135 bytes ..." SourceId: "\000src_id" SeqNo: 156 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 17061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 156 Data: "... 17245 bytes ..." SourceId: "\000src_id" SeqNo: 157 WriteTimestampMS: 1759327624980 CreateTimestampMS: 1759327624957 UncompressedSize: 17171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 157 Data: "... 17355 bytes ..." SourceId: "\000src_id" SeqNo: 158 WriteTimestampMS: 1759327624981 CreateTimestampMS: 1759327624957 UncompressedSize: 17281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 158 Data: "... 17465 bytes ..." SourceId: "\000src_id" SeqNo: 159 WriteTimestampMS: 1759327624981 CreateTimestampMS: 1759327624957 UncompressedSize: 17391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 159 Data: "... 17575 bytes ..." SourceId: "\000src_id" SeqNo: 160 WriteTimestampMS: 1759327624981 CreateTimestampMS: 1759327624957 UncompressedSize: 17501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 160 Data: "... 17685 bytes ..." SourceId: "\000src_id" SeqNo: 161 WriteTimestampMS: 1759327624981 CreateTimestampMS: 1759327624957 UncompressedSize: 17611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 161 Data: "... 17795 bytes ..." SourceId: "\000src_id" SeqNo: 162 WriteTimestampMS: 1759327624981 CreateTimestampMS: 1759327624957 UncompressedSize: 17721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 162 Data: "... 17905 bytes ..." SourceId: "\000src_id" SeqNo: 163 WriteTimestampMS: 1759327624981 CreateTimestampMS: 1759327624957 UncompressedSize: 17831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 163 Data: "... 18015 bytes ..." SourceId: "\000src_id" SeqNo: 164 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624957 UncompressedSize: 17941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 164 Data: "... 18125 bytes ..." SourceId: "\000src_id" SeqNo: 165 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624957 UncompressedSize: 18051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 165 Data: "... 18235 bytes ..." SourceId: "\000src_id" SeqNo: 166 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 166 Data: "... 18345 bytes ..." SourceId: "\000src_id" SeqNo: 167 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 167 Data: "... 18455 bytes ..." SourceId: "\000src_id" SeqNo: 168 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 168 Data: "... 18565 bytes ..." SourceId: "\000src_id" SeqNo: 169 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 169 Data: "... 18675 bytes ..." SourceId: "\000src_id" SeqNo: 170 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 170 Data: "... 18785 bytes ..." SourceId: "\000src_id" SeqNo: 171 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 171 Data: "... 18895 bytes ..." SourceId: "\000src_id" SeqNo: 172 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 172 Data: "... 19005 bytes ..." SourceId: "\000src_id" SeqNo: 173 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 18931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 173 Data: "... 19115 bytes ..." SourceId: "\000src_id" SeqNo: 174 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624958 UncompressedSize: 19041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 174 Data: "... 19225 bytes ..." SourceId: "\000src_id" SeqNo: 175 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 175 Data: "... 19335 bytes ..." SourceId: "\000src_id" SeqNo: 176 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 176 Data: "... 19445 bytes ..." SourceId: "\000src_id" SeqNo: 177 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 177 Data: "... 19555 bytes ..." SourceId: "\000src_id" SeqNo: 178 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 178 Data: "... 19665 bytes ..." SourceId: "\000src_id" SeqNo: 179 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 179 Data: "... 19775 bytes ..." SourceId: "\000src_id" SeqNo: 180 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 180 Data: "... 19885 bytes ..." SourceId: "\000src_id" SeqNo: 181 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 181 Data: "... 19995 bytes ..." SourceId: "\000src_id" SeqNo: 182 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 19921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 182 Data: "... 20105 bytes ..." SourceId: "\000src_id" SeqNo: 183 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 20031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 183 Data: "... 20215 bytes ..." SourceId: "\000src_id" SeqNo: 184 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 20141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 184 Data: "... 20325 bytes ..." SourceId: "\000src_id" SeqNo: 185 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624959 UncompressedSize: 20251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 185 Data: "... 20435 bytes ..." SourceId: "\000src_id" SeqNo: 186 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 20361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 186 Data: "... 20545 bytes ..." SourceId: "\000src_id" SeqNo: 187 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 20471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 187 Data: "... 20655 bytes ..." SourceId: "\000src_id" SeqNo: 188 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 20581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 188 Data: "... 20765 bytes ..." SourceId: "\000src_id" SeqNo: 189 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 20691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 189 Data: "... 20875 bytes ..." SourceId: "\000src_id" SeqNo: 190 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 20801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 190 Data: "... 20985 bytes ..." SourceId: "\000src_id" SeqNo: 191 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 20911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 191 Data: "... 21095 bytes ..." SourceId: "\000src_id" SeqNo: 192 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 21021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 192 Data: "... 21205 bytes ..." SourceId: "\000src_id" SeqNo: 193 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 21131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 193 Data: "... 21315 bytes ..." SourceId: "\000src_id" SeqNo: 194 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 21241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 194 Data: "... 21425 bytes ..." SourceId: "\000src_id" SeqNo: 195 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 21351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 195 Data: "... 21535 bytes ..." SourceId: "\000src_id" SeqNo: 196 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624960 UncompressedSize: 21461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 196 Data: "... 21645 bytes ..." SourceId: "\000src_id" SeqNo: 197 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 21571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 197 Data: "... 21755 bytes ..." SourceId: "\000src_id" SeqNo: 198 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 21681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 198 Data: "... 21865 bytes ..." SourceId: "\000src_id" SeqNo: 199 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 21791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 199 Data: "... 21975 bytes ..." SourceId: "\000src_id" SeqNo: 200 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 21901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 200 Data: "... 22085 bytes ..." SourceId: "\000src_id" SeqNo: 201 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 22011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 201 Data: "... 22195 bytes ..." SourceId: "\000src_id" SeqNo: 202 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 22121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 202 Data: "... 22305 bytes ..." SourceId: "\000src_id" SeqNo: 203 WriteTimestampMS: 1759327624982 CreateTimestampMS: 1759327624961 UncompressedSize: 22231 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709549396 RealReadOffset: 202 WaitQuotaTimeMs: 0 EndOffset: 203 StartOffset: 0 } Cookie: 123 }
2025-10-01T14:07:04.990716Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 191, partNo: 0, Offset: 190 is stored on disk
2025-10-01T14:07:04.997826Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997921Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997933Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997981Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.997994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990718Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.997998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990721Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 192, partNo: 0, Offset: 191 is stored on disk
2025-10-01T14:07:04.998016Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990723Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.998019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990728Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 193, partNo: 0, Offset: 192 is stored on disk
2025-10-01T14:07:04.998114Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.998119Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.998124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.998128Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.998142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.998241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.998253Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990732Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 194, partNo: 0, Offset: 193 is stored on disk
2025-10-01T14:07:04.998260Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.998267Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.998272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.998305Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 195, partNo: 0, Offset: 194 is stored on disk
2025-10-01T14:07:04.998308Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 203
2025-10-01T14:07:04.990739Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.998316Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 203 ReadOffset 203 ReadGuid 95ac45a1-bf3e89f0-f03cc989-ccf322ad has messages 1
2025-10-01T14:07:04.998410Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990742Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 196, partNo: 0, Offset: 195 is stored on disk
2025-10-01T14:07:04.998477Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 95ac45a1-bf3e89f0-f03cc989-ccf322ad, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 1434364
2025-10-01T14:07:04.990744Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.998493Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 95ac45a1-bf3e89f0-f03cc989-ccf322ad
2025-10-01T14:07:04.999186Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.999199Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.999203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 197, partNo: 0, Offset: 196 is stored on disk
2025-10-01T14:07:04.999211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990749Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.999215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 198, partNo: 0, Offset: 197 is stored on disk
2025-10-01T14:07:04.999315Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.999325Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990759Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 199, partNo: 0, Offset: 198 is stored on disk
2025-10-01T14:07:04.999330Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.999336Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 200, partNo: 0, Offset: 199 is stored on disk
2025-10-01T14:07:04.999341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990768Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.990771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 201, partNo: 0, Offset: 200 is stored on disk
2025-10-01T14:07:04.999505Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 203 EndOffset 203 newEndOffset 223 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-01T14:07:04.990772Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.999510Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 203 endOffset 223
2025-10-01T14:07:04.990775Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 202, partNo: 0, Offset: 201 is stored on disk
2025-10-01T14:07:04.999917Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:04.990778Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.000034Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 203, endOffset# 223, WTime# 1759327624982, sizeLag# 469516
2025-10-01T14:07:04.990781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 203, partNo: 0, Offset: 202 is stored on disk
2025-10-01T14:07:05.000037Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:07:05.000140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.000156Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.000161Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.000164Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-01T14:07:05.000168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.000259Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 204 partNo 0
2025-10-01T14:07:04.990878Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 204 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 22489 count 1 nextOffset 204 batches 1
2025-10-01T14:07:05.000267Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.000272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990882Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 205 partNo 0
2025-10-01T14:07:05.000277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 205 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 45056 count 2 nextOffset 205 batches 1
2025-10-01T14:07:05.000282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.001104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.001122Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.001127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.001131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.001135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.001247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.001256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.001262Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.001268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.001274Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.002152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002173Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002223Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002227Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002302Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002344Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.002349Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002468Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 206 partNo 0
2025-10-01T14:07:05.002593Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.002614Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 206 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 67733 count 3 nextOffset 206 batches 1
2025-10-01T14:07:05.002624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 207 partNo 0
2025-10-01T14:07:05.002627Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.002632Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990897Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 207 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 90520 count 4 nextOffset 207 batches 1
2025-10-01T14:07:05.002663Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990899Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 208 partNo 0
2025-10-01T14:07:05.002748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.002756Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.002790Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.002798Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990903Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 208 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 113417 count 5 nextOffset 208 batches 1
2025-10-01T14:07:05.002803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.002825Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 209 partNo 0
2025-10-01T14:07:05.002849Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.002917Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 209 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 136424 count 6 nextOffset 209 batches 1
2025-10-01T14:07:05.003029Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990911Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 210 partNo 0
2025-10-01T14:07:05.003303Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 210 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 159541 count 7 nextOffset 210 batches 1
2025-10-01T14:07:05.003354Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 211 partNo 0
2025-10-01T14:07:05.003365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 211 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 182768 count 8 nextOffset 211 batches 1
2025-10-01T14:07:05.003370Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 212 partNo 0
2025-10-01T14:07:05.003374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 212 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 206105 count 9 nextOffset 212 batches 1
2025-10-01T14:07:05.003377Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.003385Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.990931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 213 partNo 0
2025-10-01T14:07:05.003527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 213 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 229552 count 10 nextOffset 213 batches 1
2025-10-01T14:07:05.003534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990936Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 214 partNo 0
2025-10-01T14:07:05.003538Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 214 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 253109 count 11 nextOffset 214 batches 1
2025-10-01T14:07:05.003542Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.990942Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 215 partNo 0
2025-10-01T14:07:05.003546Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.003567Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.003609Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.003637Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.003722Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.003755Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.003787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.003939Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.003949Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004002Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004009Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004300Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004305Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004403Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004412Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004491Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004663Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.004893Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004905Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004910Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.004914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.006593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006621Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006627Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006632Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006817Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006825Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006851Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006856Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006861Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006866Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006870Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006875Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006982Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006986Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.006992Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.007088Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.007117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.007122Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.007127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.007135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.007450Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.007465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.007470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.007474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.007479Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010460Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010480Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010484Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010493Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010503Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010614Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010701Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010761Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.010789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013352Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013366Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013376Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013382Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013386Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013393Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013395Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.013769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.990945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 215 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 276776 count 12 nextOffset 215 batches 1
2025-10-01T14:07:04.990948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 216 partNo 0
2025-10-01T14:07:04.990953Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 216 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 300553 count 13 nextOffset 216 batches 1
2025-10-01T14:07:04.990956Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 217 partNo 0
2025-10-01T14:07:04.990959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 217 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 324440 count 14 nextOffset 217 batches 1
2025-10-01T14:07:04.990961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 218 partNo 0
2025-10-01T14:07:04.990965Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 218 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 348437 count 15 nextOffset 218 batches 1
2025-10-01T14:07:04.990967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 219 partNo 0
2025-10-01T14:07:04.990970Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 219 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 372544 count 16 nextOffset 219 batches 1
2025-10-01T14:07:04.990973Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 220 partNo 0
2025-10-01T14:07:04.990977Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 220 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 396761 count 17 nextOffset 220 batches 1
2025-10-01T14:07:04.990979Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 221 partNo 0
2025-10-01T14:07:04.990983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 221 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 421088 count 18 nextOffset 221 batches 1
2025-10-01T14:07:04.990985Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 222 partNo 0
2025-10-01T14:07:04.990990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 222 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 445525 count 19 nextOffset 222 batches 1
2025-10-01T14:07:04.990992Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 223 partNo 0
2025-10-01T14:07:04.990995Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 223 partNo 0 FormedBlobsCount 0 NewHead: Offset 203 PartNo 0 PackedSize 470072 count 20 nextOffset 223 batches 1
2025-10-01T14:07:04.990997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.991237Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 203,20 HeadOffset 203 endOffset 203 curOffset 223 d0000000000_00000000000000000203_00000_0000000020_00000? size 469516 WTime 1759327624991
2025-10-01T14:07:04.991298Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:04.991300Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:04.991304Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.991307Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:04.991309Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:04.991311Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:04.991313Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:04.991315Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000123_00000_0000000080_00000?
2025-10-01T14:07:04.991318Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 2275382 bytes (2275382)
2025-10-01T14:07:04.991322Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 8, size 2275382 (8388608)
2025-10-01T14:07:04.991408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991421Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 224 partNo : 0 messageNo: 451 size 24615 offset: -1
2025-10-01T14:07:04.991431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 251  requestId: <none> cookie: 124
2025-10-01T14:07:04.991453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 252  requestId: <none> cookie: 125
2025-10-01T14:07:04.991459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 253  requestId: <none> cookie: 126
2025-10-01T14:07:04.991465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 254  requestId: <none> cookie: 127
2025-10-01T14:07:04.991471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 255  requestId: <none> cookie: 128
2025-10-01T14:07:04.991486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 225 partNo : 0 messageNo: 452 size 24725 offset: -1
2025-10-01T14:07:04.991497Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 261  requestId: <none> cookie: 129
2025-10-01T14:07:04.991506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 262  requestId: <none> cookie: 130
2025-10-01T14:07:04.991518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 226 partNo : 0 messageNo: 453 size 24835 offset: -1
2025-10-01T14:07:04.991529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 263  requestId: <none> cookie: 131
2025-10-01T14:07:04.991546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991552Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 227 partNo : 0 messageNo: 454 size 24945 offset: -1
2025-10-01T14:07:04.991557Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 264  requestId: <none> cookie: 132
2025-10-01T14:07:04.991564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 265  requestId: <none> cookie: 133
2025-10-01T14:07:04.991569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 271  requestId: <none> cookie: 134
2025-10-01T14:07:04.991575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 272  requestId: <none> cookie: 135
2025-10-01T14:07:04.991588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991595Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 228 partNo : 0 messageNo: 455 size 25055 offset: -1
2025-10-01T14:07:04.991600Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 273  requestId: <none> cookie: 136
2025-10-01T14:07:04.991611Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 274  requestId: <none> cookie: 137
2025-10-01T14:07:04.991616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 275  requestId: <none> cookie: 138
2025-10-01T14:07:04.991622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 281  requestId: <none> cookie: 139
2025-10-01T14:07:04.991628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 282  requestId: <none> cookie: 140
2025-10-01T14:07:04.991633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 283  requestId: <none> cookie: 141
2025-10-01T14:07:04.991640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 284  requestId: <none> cookie: 142
2025-10-01T14:07:04.991645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 285  requestId: <none> cookie: 143
2025-10-01T14:07:04.991650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 291  requestId: <none> cookie: 144
2025-10-01T14:07:04.991655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 292  requestId: <none> cookie: 145
2025-10-01T14:07:04.991660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 293  requestId: <none> cookie: 146
2025-10-01T14:07:04.991666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 294  requestId: <none> cookie: 147
2025-10-01T14:07:04.991672Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 295  requestId: <none> cookie: 148
2025-10-01T14:07:04.991691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 301  requestId: <none> cookie: 149
2025-10-01T14:07:04.991697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 302  requestId: <none> cookie: 150
2025-10-01T14:07:04.991701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 303  requestId: <none> cookie: 151
2025-10-01T14:07:04.991706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 304  requestId: <none> cookie: 152
2025-10-01T14:07:04.991712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 305  requestId: <none> cookie: 153
2025-10-01T14:07:04.991718Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 311  requestId: <none> cookie: 154
2025-10-01T14:07:04.991724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 312  requestId: <none> cookie: 155
2025-10-01T14:07:04.991729Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 313  requestId: <none> cookie: 156
2025-10-01T14:07:04.991735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 314  requestId: <none> cookie: 157
2025-10-01T14:07:04.991740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 315  requestId: <none> cookie: 158
2025-10-01T14:07:04.991744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 321  requestId: <none> cookie: 159
2025-10-01T14:07:04.991749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 322  requestId: <none> cookie: 160
2025-10-01T14:07:04.991755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 323  requestId: <none> cookie: 161
2025-10-01T14:07:04.991761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 324  requestId: <none> cookie: 162
2025-10-01T14:07:04.991768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 325  requestId: <none> cookie: 163
2025-10-01T14:07:04.991773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 331  requestId: <none> cookie: 164
2025-10-01T14:07:04.991780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 332  requestId: <none> cookie: 165
2025-10-01T14:07:04.991786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 333  requestId: <none> cookie: 166
2025-10-01T14:07:04.991791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 334  requestId: <none> cookie: 167
2025-10-01T14:07:04.991795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 335  requestId: <none> cookie: 168
2025-10-01T14:07:04.991801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 341  requestId: <none> cookie: 169
2025-10-01T14:07:04.991806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 342  requestId: <none> cookie: 170
2025-10-01T14:07:04.991811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 343  requestId: <none> cookie: 171
2025-10-01T14:07:04.991817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 344  requestId: <none> cookie: 172
2025-10-01T14:07:04.991822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 345  requestId: <none> cookie: 173
2025-10-01T14:07:04.991828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 351  requestId: <none> cookie: 174
2025-10-01T14:07:04.991833Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 352  requestId: <none> cookie: 175
2025-10-01T14:07:04.991838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 353  requestId: <none> cookie: 176
2025-10-01T14:07:04.991845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991858Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 354  requestId: <none> cookie: 177
2025-10-01T14:07:04.991863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 355  requestId: <none> cookie: 178
2025-10-01T14:07:04.991881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.991883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.991888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 361  requestId: <none> cookie: 179
2025-10-01T14:07:04.991894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 362  requestId: <none> cookie: 180
2025-10-01T14:07:04.991900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 363  requestId: <none> cookie: 181
2025-10-01T14:07:04.991905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 364  requestId: <none> cookie: 182
2025-10-01T14:07:04.991910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 365  requestId: <none> cookie: 183
2025-10-01T14:07:04.991916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 371  requestId: <none> cookie: 184
2025-10-01T14:07:04.991922Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 372  requestId: <none> cookie: 185
2025-10-01T14:07:04.991927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 373  requestId: <none> cookie: 186
2025-10-01T14:07:04.991933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 374  requestId: <none> cookie: 187
2025-10-01T14:07:04.991940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 375  requestId: <none> cookie: 188
2025-10-01T14:07:04.991945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 381  requestId: <none> cookie: 189
2025-10-01T14:07:04.991951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 382  requestId: <none> cookie: 190
2025-10-01T14:07:04.991956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 383  requestId: <none> cookie: 191
2025-10-01T14:07:04.991961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 384  requestId: <none> cookie: 192
2025-10-01T14:07:04.991967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 385  requestId: <none> cookie: 193
2025-10-01T14:07:04.991972Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 391  requestId: <none> cookie: 194
2025-10-01T14:07:04.991978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 392  requestId: <none> cookie: 195
2025-10-01T14:07:04.991984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 393  requestId: <none> cookie: 196
2025-10-01T14:07:04.991990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 394  requestId: <none> cookie: 197
2025-10-01T14:07:04.991995Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 395  requestId: <none> cookie: 198
2025-10-01T14:07:04.992000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 401  requestId: <none> cookie: 199
2025-10-01T14:07:04.992005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 402  requestId: <none> cookie: 200
2025-10-01T14:07:04.992011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 403  requestId: <none> cookie: 201
2025-10-01T14:07:04.992016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 404  requestId: <none> cookie: 202
2025-10-01T14:07:04.992022Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 405  requestId: <none> cookie: 203
2025-10-01T14:07:04.992030Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.992043Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 203 partNo 0 count 20 size 469516
2025-10-01T14:07:04.992063Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.992072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.992074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.992076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.992078Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.992080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.992082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.992084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.992086Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.992088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.992141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 456  requestId: <none> cookie: 229
2025-10-01T14:07:04.992149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 457  requestId: <none> cookie: 230
2025-10-01T14:07:04.992152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 458  requestId: <none> cookie: 231
2025-10-01T14:07:04.992155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 459  requestId: <none> cookie: 232
2025-10-01T14:07:04.992158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 460  requestId: <none> cookie: 233
2025-10-01T14:07:04.993033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 229 partNo : 0 messageNo: 461 size 25165 offset: -1
2025-10-01T14:07:04.993069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 230 partNo : 0 messageNo: 462 size 25275 offset: -1
2025-10-01T14:07:04.993088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 231 partNo : 0 messageNo: 463 size 25385 offset: -1
2025-10-01T14:07:04.993108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 232 partNo : 0 messageNo: 464 size 25495 offset: -1
2025-10-01T14:07:04.993130Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993135Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 233 partNo : 0 messageNo: 465 size 25605 offset: -1
2025-10-01T14:07:04.993140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993169Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.993175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.993178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.993181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.993183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.993186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.993188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.993190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.993192Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.993194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.993205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 466  requestId: <none> cookie: 234
2025-10-01T14:07:04.993209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 467  requestId: <none> cookie: 235
2025-10-01T14:07:04.993213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 468  requestId: <none> cookie: 236
2025-10-01T14:07:04.993215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 469  requestId: <none> cookie: 237
2025-10-01T14:07:04.993218Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 470  requestId: <none> cookie: 238
2025-10-01T14:07:04.993364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.993367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.993392Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 123 count 96 size 524288 endOffset 203 max time lag 0ms effective offset 123
2025-10-01T14:07:04.993408Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1437910 count 80 last offset 123, current partition end offset: 203
2025-10-01T14:07:04.993411Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-01T14:07:04.993422Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 123 partno 0 count 80 parts_count 0 source 1 size 1437910 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:04.993433Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-01T14:07:04.993444Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.993544Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 123 partno 0 count 80 parts 0 suffix '63'
2025-10-01T14:07:04.993802Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 123 totakecount 80 count 34 size 525010 from pos 0 cbcount 34
2025-10-01T14:07:04.994053Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 157 totakecount 80 count 28 size 527901 from pos 0 cbcount 28
2025-10-01T14:07:04.994249Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 185 totakecount 80 count 18 size 384931 from pos 0 cbcount 18
2025-10-01T14:07:04.994323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 234 partNo : 0 messageNo: 471 size 25715 offset: -1
2025-10-01T14:07:04.994352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 235 partNo : 0 messageNo: 472 size 25825 offset: -1
2025-10-01T14:07:04.994391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 236 partNo : 0 messageNo: 473 size 25935 offset: -1
2025-10-01T14:07:04.994408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 237 partNo : 0 messageNo: 474 size 26045 offset: -1
2025-10-01T14:07:04.994425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 238 partNo : 0 messageNo: 475 size 26155 offset: -1
2025-10-01T14:07:04.994433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994456Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.994462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.994512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 123
2025-10-01T14:07:04.994541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.994547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.994549Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.994551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.994552Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.994555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.994556Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.994558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.994560Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.994562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.994851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 476  requestId: <none> cookie: 239
2025-10-01T14:07:04.994856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 477  requestId: <none> cookie: 240
2025-10-01T14:07:04.994859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 478  requestId: <none> cookie: 241
2025-10-01T14:07:04.994863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 479  requestId: <none> cookie: 242
2025-10-01T14:07:04.994867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 480  requestId: <none> cookie: 243
2025-10-01T14:07:04.996251Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 239 partNo : 0 messageNo: 481 size 26265 offset: -1
2025-10-01T14:07:04.996276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.996284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.996431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 240 partNo : 0 messageNo: 482 size 26375 offset: -1
2025-10-01T14:07:04.996476Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 241 partNo : 0 messageNo: 483 size 26485 offset: -1
2025-10-01T14:07:04.996500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 242 partNo : 0 messageNo: 484 size 26595 offset: -1
2025-10-01T14:07:04.996534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 243 partNo : 0 messageNo: 485 size 26705 offset: -1
2025-10-01T14:07:04.996548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996565Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.996577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.996582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.996588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.996590Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.996593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.996594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.996609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.996658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.996667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.996687Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 203 count 20 size 469516 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:04.996703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 486  requestId: <none> cookie: 244
2025-10-01T14:07:04.996712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 487  requestId: <none> cookie: 245
2025-10-01T14:07:04.996715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 488  requestId: <none> cookie: 246
2025-10-01T14:07:04.996716Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 203 partno 0 count 20 parts 0 suffix '63' size 469516
2025-10-01T14:07:04.996720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 489  requestId: <none> cookie: 247
2025-10-01T14:07:04.996724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 490  requestId: <none> cookie: 248
2025-10-01T14:07:04.996729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:04.996751Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 469340 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:04.996759Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 204, partNo: 0, Offset: 203 is stored on disk
2025-10-01T14:07:04.996770Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
>>> event from dataHandler: 2025-10-01T14:07:04.996775Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 205, partNo: 0, Offset: 204 is stored on disk
2025-10-01T14:07:04.996777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996779Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 206, partNo: 0, Offset: 205 is stored on disk
2025-10-01T14:07:04.996781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 207, partNo: 0, Offset: 206 is stored on disk
2025-10-01T14:07:04.996786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996789Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 208, partNo: 0, Offset: 207 is stored on disk
2025-10-01T14:07:04.996790Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996793Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 209, partNo: 0, Offset: 208 is stored on disk
2025-10-01T14:07:04.996795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996798Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 210, partNo: 0, Offset: 209 is stored on disk
2025-10-01T14:07:04.996802Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996805Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 211, partNo: 0, Offset: 210 is stored on disk
2025-10-01T14:07:04.996807Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996810Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 212, partNo: 0, Offset: 211 is stored on disk
2025-10-01T14:07:04.996812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 213, partNo: 0, Offset: 212 is stored on disk
2025-10-01T14:07:04.996817Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 214, partNo: 0, Offset: 213 is stored on disk
2025-10-01T14:07:04.996822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996825Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 215, partNo: 0, Offset: 214 is stored on disk
2025-10-01T14:07:04.996846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 216, partNo: 0, Offset: 215 is stored on disk
2025-10-01T14:07:04.996854Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996857Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 217, partNo: 0, Offset: 216 is stored on disk
2025-10-01T14:07:04.996859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 218, partNo: 0, Offset: 217 is stored on disk
2025-10-01T14:07:04.996865Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 219, partNo: 0, Offset: 218 is stored on disk
2025-10-01T14:07:04.996870Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996875Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 220, partNo: 0, Offset: 219 is stored on disk
2025-10-01T14:07:05.049875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 142 offsets: 141 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.996877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996881Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 221, partNo: 0, Offset: 220 is stored on disk
2025-10-01T14:07:04.996883Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 222, partNo: 0, Offset: 221 is stored on disk
2025-10-01T14:07:04.996889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:04.996892Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 223, partNo: 0, Offset: 222 is stored on disk
2025-10-01T14:07:04.996918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.059729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 142
2025-10-01T14:07:04.996936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.996938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-01T14:07:04.996957Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 224 partNo 0
2025-10-01T14:07:04.996984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 224 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 24689 count 1 nextOffset 224 batches 1
2025-10-01T14:07:04.996991Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 225 partNo 0
2025-10-01T14:07:04.996996Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 225 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 49456 count 2 nextOffset 225 batches 1
2025-10-01T14:07:04.997001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 226 partNo 0
2025-10-01T14:07:04.997006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 226 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 74333 count 3 nextOffset 226 batches 1
2025-10-01T14:07:04.997009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 227 partNo 0
2025-10-01T14:07:04.997013Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 227 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 99320 count 4 nextOffset 227 batches 1
2025-10-01T14:07:04.997017Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 228 partNo 0
2025-10-01T14:07:04.997022Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 228 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 124417 count 5 nextOffset 228 batches 1
2025-10-01T14:07:04.997024Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 229 partNo 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..13541 bytes.. Information: { Offset: 123 ProducerId: "src_id" SeqNo: 124 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13651 bytes.. Information: { Offset: 124 ProducerId: "src_id" SeqNo: 125 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13761 bytes.. Information: { Offset: 125 ProducerId: "src_id" SeqNo: 126 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13871 bytes.. Information: { Offset: 126 ProducerId: "src_id" SeqNo: 127 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13981 bytes.. Information: { Offset: 127 ProducerId: "src_id" SeqNo: 128 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14091 bytes.. Information: { Offset: 128 ProducerId: "src_id" SeqNo: 129 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14201 bytes.. Information: { Offset: 129 ProducerId: "src_id" SeqNo: 130 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14311 bytes.. Information: { Offset: 130 ProducerId: "src_id" SeqNo: 131 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14421 bytes.. Information: { Offset: 131 ProducerId: "src_id" SeqNo: 132 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14531 bytes.. Information: { Offset: 132 ProducerId: "src_id" SeqNo: 133 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14641 bytes.. Information: { Offset: 133 ProducerId: "src_id" SeqNo: 134 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14751 bytes.. Information: { Offset: 134 ProducerId: "src_id" SeqNo: 135 CreateTime: 2025-10-01T14:07:04.955000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14861 bytes.. Information: { Offset: 135 ProducerId: "src_id" SeqNo: 136 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14971 bytes.. Information: { Offset: 136 ProducerId: "src_id" SeqNo: 137 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15081 bytes.. Information: { Offset: 137 ProducerId: "src_id" SeqNo: 138 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15191 bytes.. Information: { Offset: 138 ProducerId: "src_id" SeqNo: 139 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15301 bytes.. Information: { Offset: 139 ProducerId: "src_id" SeqNo: 140 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15411 bytes.. Information: { Offset: 140 ProducerId: "src_id" SeqNo: 141 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15521 bytes.. Information: { Offset: 141 ProducerId: "src_id" SeqNo: 142 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15631 bytes.. Information: { Offset: 142 ProducerId: "src_id" SeqNo: 143 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15741 bytes.. Information: { Offset: 143 ProducerId: "src_id" SeqNo: 144 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15851 bytes.. Information: { Offset: 144 ProducerId: "src_id" SeqNo: 145 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15961 bytes.. Information: { Offset: 145 ProducerId: "src_id" SeqNo: 146 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16071 bytes.. Information: { Offset: 146 ProducerId: "src_id" SeqNo: 147 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16181 bytes.. Information: { Offset: 147 ProducerId: "src_id" SeqNo: 148 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16291 bytes.. Information: { Offset: 148 ProducerId: "src_id" SeqNo: 149 CreateTime: 2025-10-01T14:07:04.956000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16401 bytes.. Information: { Offset: 149 ProducerId: "src_id" SeqNo: 150 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16511 bytes.. Information: { Offset: 150 ProducerId: "src_id" SeqNo: 151 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16621 bytes.. Information: { Offset: 151 ProducerId: "src_id" SeqNo: 152 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16731 bytes.. Information: { Offset: 152 ProducerId: "src_id" SeqNo: 153 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16841 bytes.. Information: { Offset: 153 ProducerId: "src_id" SeqNo: 154 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16951 bytes.. Information: { Offset: 154 ProducerId: "src_id" SeqNo: 155 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17061 bytes.. Information: { Offset: 155 ProducerId: "src_id" SeqNo: 156 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17171 bytes.. Information: { Offset: 156 ProducerId: "src_id" SeqNo: 157 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.980000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17281 bytes.. Information: { Offset: 157 ProducerId: "src_id" SeqNo: 158 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.981000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:04.997029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 229 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 149624 count 6 nextOffset 229 batches 1
2025-10-01T14:07:04.997031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 230 partNo 0
2025-10-01T14:07:04.997035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 230 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 174941 count 7 nextOffset 230 batches 1
2025-10-01T14:07:04.997038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 231 partNo 0
2025-10-01T14:07:04.997041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 231 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 200368 count 8 nextOffset 231 batches 1
2025-10-01T14:07:04.997044Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 232 partNo 0
2025-10-01T14:07:04.997053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 232 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 225905 count 9 nextOffset 232 batches 1
2025-10-01T14:07:04.997056Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 233 partNo 0
2025-10-01T14:07:04.997060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 233 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 251552 count 10 nextOffset 233 batches 1
2025-10-01T14:07:04.997064Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 234 partNo 0
2025-10-01T14:07:04.997069Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 234 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 277309 count 11 nextOffset 234 batches 1
2025-10-01T14:07:04.997072Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 235 partNo 0
2025-10-01T14:07:04.997075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 235 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 303176 count 12 nextOffset 235 batches 1
2025-10-01T14:07:04.997078Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 236 partNo 0
2025-10-01T14:07:04.997082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 236 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 329153 count 13 nextOffset 236 batches 1
2025-10-01T14:07:04.997085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 237 partNo 0
2025-10-01T14:07:04.997088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 237 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 355240 count 14 nextOffset 237 batches 1
2025-10-01T14:07:04.997091Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 238 partNo 0
2025-10-01T14:07:04.997094Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 238 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 381437 count 15 nextOffset 238 batches 1
2025-10-01T14:07:04.997097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 239 partNo 0
2025-10-01T14:07:04.997100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 239 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 407744 count 16 nextOffset 239 batches 1
2025-10-01T14:07:04.997103Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 240 partNo 0
2025-10-01T14:07:04.997107Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 240 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 434161 count 17 nextOffset 240 batches 1
2025-10-01T14:07:04.997109Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 241 partNo 0
2025-10-01T14:07:04.997112Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 241 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 460688 count 18 nextOffset 241 batches 1
2025-10-01T14:07:04.997115Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 242 partNo 0
2025-10-01T14:07:04.997119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 242 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 487325 count 19 nextOffset 242 batches 1
2025-10-01T14:07:04.997122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 243 partNo 0
2025-10-01T14:07:04.997516Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 243 partNo 0 FormedBlobsCount 0 NewHead: Offset 223 PartNo 0 PackedSize 513516 count 20 nextOffset 243 batches 1
2025-10-01T14:07:04.997526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.997577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 223,20 HeadOffset 223 endOffset 223 curOffset 243 d0000000000_00000000000000000223_00000_0000000020_00000? size 513516 WTime 1759327624997
2025-10-01T14:07:04.997640Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:05.059908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 143 offsets: 142 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.997643Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:05.059914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 143
2025-10-01T14:07:04.997646Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:04.997649Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:04.997651Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:04.997653Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:04.997656Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:05.059933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 144 offsets: 143 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.997658Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000123_00000_0000000080_00000?
2025-10-01T14:07:05.059936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 144
2025-10-01T14:07:04.997660Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000203_00000_0000000020_00000?
2025-10-01T14:07:04.997663Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 2744898 bytes (2744898)
2025-10-01T14:07:05.059942Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 35, size 539385 bytes
2025-10-01T14:07:04.997667Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 9, size 2744898 (8388608)
2025-10-01T14:07:04.997685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 411  requestId: <none> cookie: 204
2025-10-01T14:07:05.059952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 145 offsets: 144 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.997703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 412  requestId: <none> cookie: 205
2025-10-01T14:07:04.997708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 413  requestId: <none> cookie: 206
2025-10-01T14:07:04.997713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 414  requestId: <none> cookie: 207
2025-10-01T14:07:04.997719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 415  requestId: <none> cookie: 208
2025-10-01T14:07:04.997724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 421  requestId: <none> cookie: 209
2025-10-01T14:07:04.997730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 422  requestId: <none> cookie: 210
2025-10-01T14:07:04.997735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 423  requestId: <none> cookie: 211
2025-10-01T14:07:04.997741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 424  requestId: <none> cookie: 212
2025-10-01T14:07:04.997746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 425  requestId: <none> cookie: 213
2025-10-01T14:07:04.997752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 431  requestId: <none> cookie: 214
2025-10-01T14:07:04.997757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 432  requestId: <none> cookie: 215
2025-10-01T14:07:04.997763Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 433  requestId: <none> cookie: 216
2025-10-01T14:07:04.997769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 434  requestId: <none> cookie: 217
2025-10-01T14:07:05.059955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 145
2025-10-01T14:07:04.997777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 435  requestId: <none> cookie: 218
2025-10-01T14:07:04.997783Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 441  requestId: <none> cookie: 219
2025-10-01T14:07:05.060016Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (158-185)
2025-10-01T14:07:05.060030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 146 offsets: 145 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.060033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 146
2025-10-01T14:07:04.997789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 442  requestId: <none> cookie: 220
2025-10-01T14:07:05.060039Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:04.997793Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 443  requestId: <none> cookie: 221
2025-10-01T14:07:05.060046Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 1434364, ReadSizeServerDelta = -910076
2025-10-01T14:07:05.060051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 147 offsets: 146 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.060054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 147
2025-10-01T14:07:04.997799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 444  requestId: <none> cookie: 222
2025-10-01T14:07:04.997806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 445  requestId: <none> cookie: 223
2025-10-01T14:07:04.997825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 148 offsets: 147 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.997829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 148
2025-10-01T14:07:04.997838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 244 partNo : 0 messageNo: 491 size 26815 offset: -1
2025-10-01T14:07:04.997852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 149 offsets: 148 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.060101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 149
2025-10-01T14:07:04.997857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 245 partNo : 0 messageNo: 492 size 26925 offset: -1
2025-10-01T14:07:04.997870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 150 offsets: 149 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.997874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 246 partNo : 0 messageNo: 493 size 27035 offset: -1
2025-10-01T14:07:05.060117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 150
2025-10-01T14:07:04.997885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.997890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 247 partNo : 0 messageNo: 494 size 27145 offset: -1
2025-10-01T14:07:04.997905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.997911Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 248 partNo : 0 messageNo: 495 size 27255 offset: -1
2025-10-01T14:07:04.997915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.997921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997922Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.997926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.997931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.997936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.997937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060169Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:04.997942Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.997954Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 223 partNo 0 count 20 size 513516
2025-10-01T14:07:04.997963Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.997970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.997971Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.997974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.997976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.997979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.997982Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.997984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.997986Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.997988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.998035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 496  requestId: <none> cookie: 249
2025-10-01T14:07:05.060205Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (158-158)
2025-10-01T14:07:04.998048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 497  requestId: <none> cookie: 250
2025-10-01T14:07:04.998051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 498  requestId: <none> cookie: 251
2025-10-01T14:07:04.998053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 499  requestId: <none> cookie: 252
2025-10-01T14:07:04.998056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 500  requestId: <none> cookie: 253
2025-10-01T14:07:05.060234Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (159-159)
2025-10-01T14:07:04.998239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.998243Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 249 partNo : 0 messageNo: 501 size 27365 offset: -1
2025-10-01T14:07:04.998267Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060244Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (160-160)
2025-10-01T14:07:04.998268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 250 partNo : 0 messageNo: 502 size 27475 offset: -1
2025-10-01T14:07:05.060251Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (161-161)
2025-10-01T14:07:04.998286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.998287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 251 partNo : 0 messageNo: 503 size 27585 offset: -1
2025-10-01T14:07:04.998303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060264Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (162-162)
2025-10-01T14:07:04.998305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 252 partNo : 0 messageNo: 504 size 27695 offset: -1
2025-10-01T14:07:05.060270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 151 offsets: 150 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.998312Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.060280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 151
2025-10-01T14:07:05.060271Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (163-163)
2025-10-01T14:07:04.998320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.998335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.998336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 253 partNo : 0 messageNo: 505 size 27805 offset: -1
2025-10-01T14:07:04.998343Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.998346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.060336Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (164-164)
2025-10-01T14:07:04.998347Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.060351Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (165-165)
2025-10-01T14:07:04.998349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.060348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 152 offsets: 151 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.998351Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.998354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.060337Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 1434364 } }
2025-10-01T14:07:04.998359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 152
2025-10-01T14:07:04.998360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.998367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998384Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.998385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 153 offsets: 152 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.998389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.998391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 153
2025-10-01T14:07:04.998399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.998405Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.998408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.060421Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (166-166)
2025-10-01T14:07:04.998420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 506  requestId: <none> cookie: 254
2025-10-01T14:07:04.998434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 507  requestId: <none> cookie: 255
2025-10-01T14:07:05.060430Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (167-167)
2025-10-01T14:07:04.998437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 508  requestId: <none> cookie: 256
2025-10-01T14:07:05.060437Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (168-168)
2025-10-01T14:07:04.998440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 509  requestId: <none> cookie: 257
2025-10-01T14:07:05.060432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 154 offsets: 153 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.998443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 510  requestId: <none> cookie: 258
2025-10-01T14:07:05.060429Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 84379d01-8e90b608-1efab399-4d1c4a4f
2025-10-01T14:07:04.999669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060455Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# e351c38e-bb44e83c-3f740cd3-274e6591, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:04.999678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060443Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 6} (169-169)
2025-10-01T14:07:05.060451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 154
2025-10-01T14:07:05.060471Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 7} (170-170)
2025-10-01T14:07:04.999692Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 254 partNo : 0 messageNo: 511 size 27915 offset: -1
2025-10-01T14:07:05.060481Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 8} (171-171)
2025-10-01T14:07:04.999710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.060488Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 9} (172-172)
2025-10-01T14:07:04.999711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 155 offsets: 154 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.060486Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 203 EndOffset 223 ClientCommitOffset 0 committedOffset 0 Guid e351c38e-bb44e83c-3f740cd3-274e6591
2025-10-01T14:07:05.064423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 155
2025-10-01T14:07:05.064134Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 567756, now ReadSizeBudget = 0, ReadSizeServerDelta = -43468
2025-10-01T14:07:05.062826Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 203 Data: "... 22415 bytes ..." SourceId: "\000src_id" SeqNo: 204 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 22341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 204 Data: "... 22525 bytes ..." SourceId: "\000src_id" SeqNo: 205 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 22451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 205 Data: "... 22635 bytes ..." SourceId: "\000src_id" SeqNo: 206 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 22561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 206 Data: "... 22745 bytes ..." SourceId: "\000src_id" SeqNo: 207 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 22671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 207 Data: "... 22855 bytes ..." SourceId: "\000src_id" SeqNo: 208 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 22781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 208 Data: "... 22965 bytes ..." SourceId: "\000src_id" SeqNo: 209 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 22891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 209 Data: "... 23075 bytes ..." SourceId: "\000src_id" SeqNo: 210 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 23001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 210 Data: "... 23185 bytes ..." SourceId: "\000src_id" SeqNo: 211 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 23111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 211 Data: "... 23295 bytes ..." SourceId: "\000src_id" SeqNo: 212 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 23221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 212 Data: "... 23405 bytes ..." SourceId: "\000src_id" SeqNo: 213 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624961 UncompressedSize: 23331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 213 Data: "... 23515 bytes ..." SourceId: "\000src_id" SeqNo: 214 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 23441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 214 Data: "... 23625 bytes ..." SourceId: "\000src_id" SeqNo: 215 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 23551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 215 Data: "... 23735 bytes ..." SourceId: "\000src_id" SeqNo: 216 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 23661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 216 Data: "... 23845 bytes ..." SourceId: "\000src_id" SeqNo: 217 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 23771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 217 Data: "... 23955 bytes ..." SourceId: "\000src_id" SeqNo: 218 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 23881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 218 Data: "... 24065 bytes ..." SourceId: "\000src_id" SeqNo: 219 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 23991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 219 Data: "... 24175 bytes ..." SourceId: "\000src_id" SeqNo: 220 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 24101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 220 Data: "... 24285 bytes ..." SourceId: "\000src_id" SeqNo: 221 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 24211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 221 Data: "... 24395 bytes ..." SourceId: "\000src_id" SeqNo: 222 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 24321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 222 Data: "... 24505 bytes ..." SourceId: "\000src_id" SeqNo: 223 WriteTimestampMS: 1759327624986 CreateTimestampMS: 1759327624962 UncompressedSize: 24431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 223 Data: "... 24615 bytes ..." SourceId: "\000src_id" SeqNo: 224 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624962 UncompressedSize: 24541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 224 Data: "... 24725 bytes ..." SourceId: "\000src_id" SeqNo: 225 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624962 UncompressedSize: 24651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 225 Data: "... 24835 bytes ..." SourceId: "\000src_id" SeqNo: 226 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624962 UncompressedSize: 24761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 226 Data: "... 24945 bytes ..." SourceId: "\000src_id" SeqNo: 227 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 24871 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 2104964 RealReadOffset: 226 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 203 }
2025-10-01T14:07:05.064395Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 10} (173-173)
2025-10-01T14:07:04.999718Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 255 partNo : 0 messageNo: 512 size 28025 offset: -1
2025-10-01T14:07:04.999731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.999732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.999736Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 256 partNo : 0 messageNo: 513 size 28135 offset: -1
2025-10-01T14:07:04.999749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.063035Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 227 endOffset 300
2025-10-01T14:07:04.999751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.063052Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 227 ReadGuid e351c38e-bb44e83c-3f740cd3-274e6591 has messages 1
2025-10-01T14:07:04.999754Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 257 partNo : 0 messageNo: 514 size 28245 offset: -1
2025-10-01T14:07:05.064507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 156 offsets: 155 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.999767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.999770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 156
2025-10-01T14:07:05.063076Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 227, endOffset# 300, WTime# 1759327624996, sizeLag# 2104964
2025-10-01T14:07:04.999775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 258 partNo : 0 messageNo: 515 size 28355 offset: -1
2025-10-01T14:07:05.063081Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:07:05.064534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 157 offsets: 156 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:05.063110Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# e351c38e-bb44e83c-3f740cd3-274e6591, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 567756
2025-10-01T14:07:04.999788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.999789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064546Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 11} (174-174)
2025-10-01T14:07:04.999796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.063121Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# e351c38e-bb44e83c-3f740cd3-274e6591
2025-10-01T14:07:05.064538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 157
2025-10-01T14:07:05.063851Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 1
2025-10-01T14:07:05.064560Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 12} (175-175)
2025-10-01T14:07:05.064566Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 13} (176-176)
2025-10-01T14:07:04.999797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064572Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 14} (177-177)
2025-10-01T14:07:05.064579Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 15} (178-178)
2025-10-01T14:07:05.064579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 158 offsets: 157 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 7 }
2025-10-01T14:07:04.999801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.064583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 158
2025-10-01T14:07:04.999803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064585Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 16} (179-179)
2025-10-01T14:07:04.999808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.999809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064594Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 17} (180-180)
2025-10-01T14:07:04.999813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.064598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 159 offsets: 158 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.999814Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 159
2025-10-01T14:07:05.064603Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 18} (181-181)
2025-10-01T14:07:04.999835Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.999852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.999855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.999856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.064617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 160 offsets: 159 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:04.999858Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.064621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 160
2025-10-01T14:07:04.999860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.999863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.999866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:04.999868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.064635Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 19} (182-182)
2025-10-01T14:07:05.064637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 161 offsets: 160 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.064645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 161
2025-10-01T14:07:04.999870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.000045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 516  requestId: <none> cookie: 259
2025-10-01T14:07:05.064655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 20} (183-183)
2025-10-01T14:07:05.000058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 517  requestId: <none> cookie: 260
2025-10-01T14:07:05.000062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 518  requestId: <none> cookie: 261
2025-10-01T14:07:05.064660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 162 offsets: 161 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.000065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 519  requestId: <none> cookie: 262
2025-10-01T14:07:05.064665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 162
2025-10-01T14:07:05.000068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 520  requestId: <none> cookie: 263
2025-10-01T14:07:05.064670Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 21} (184-184)
2025-10-01T14:07:05.000717Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 259 partNo : 0 messageNo: 521 size 28465 offset: -1
2025-10-01T14:07:05.064681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 163 offsets: 162 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.064686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 163
2025-10-01T14:07:05.064688Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 22} (185-185)
2025-10-01T14:07:05.000771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 260 partNo : 0 messageNo: 522 size 28575 offset: -1
2025-10-01T14:07:05.000793Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 261 partNo : 0 messageNo: 523 size 28685 offset: -1
2025-10-01T14:07:05.064705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 164 offsets: 163 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.064708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 164
2025-10-01T14:07:05.000818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 262 partNo : 0 messageNo: 524 size 28795 offset: -1
2025-10-01T14:07:05.064723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 165 offsets: 164 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.064731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 165
2025-10-01T14:07:05.000857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 263 partNo : 0 messageNo: 525 size 28905 offset: -1
2025-10-01T14:07:05.000869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.064747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 166 offsets: 165 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.000871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.064750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 166
2025-10-01T14:07:05.000876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000878Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.064766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 167 offsets: 166 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.064774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 167
2025-10-01T14:07:05.000892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.000898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.000905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.064789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 168 offsets: 167 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 6 }
2025-10-01T14:07:05.000914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.064794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 168
2025-10-01T14:07:05.000917Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.000920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.000921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.000926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.000928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.000932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.064816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 169 offsets: 168 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.000934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.064842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 169
2025-10-01T14:07:05.000936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.001012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 526  requestId: <none> cookie: 264
2025-10-01T14:07:05.001031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 527  requestId: <none> cookie: 265
2025-10-01T14:07:05.064860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 170 offsets: 169 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.064864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 170
2025-10-01T14:07:05.001049Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 223 count 20 size 513516 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:05.001065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 528  requestId: <none> cookie: 266
2025-10-01T14:07:05.001069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 529  requestId: <none> cookie: 267
2025-10-01T14:07:05.001072Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 223 partno 0 count 20 parts 0 suffix '63' size 513516
2025-10-01T14:07:05.064879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 171 offsets: 170 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001085Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 530  requestId: <none> cookie: 268
2025-10-01T14:07:05.001091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:05.064883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 171
2025-10-01T14:07:05.001108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 513340 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:05.001118Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001126Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 224, partNo: 0, Offset: 223 is stored on disk
2025-10-01T14:07:05.001129Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.064913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 172 offsets: 171 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.064921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 172
2025-10-01T14:07:05.001133Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 225, partNo: 0, Offset: 224 is stored on disk
2025-10-01T14:07:05.001134Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001138Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 226, partNo: 0, Offset: 225 is stored on disk
2025-10-01T14:07:05.001140Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.064937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 173 offsets: 172 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 227, partNo: 0, Offset: 226 is stored on disk
2025-10-01T14:07:05.064940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 173
2025-10-01T14:07:05.001145Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001150Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 228, partNo: 0, Offset: 227 is stored on disk
2025-10-01T14:07:05.001152Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001156Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 229, partNo: 0, Offset: 228 is stored on disk
2025-10-01T14:07:05.001158Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 230, partNo: 0, Offset: 229 is stored on disk
2025-10-01T14:07:05.064958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 174 offsets: 173 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001164Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.064962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 174
2025-10-01T14:07:05.001168Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 231, partNo: 0, Offset: 230 is stored on disk
2025-10-01T14:07:05.001170Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001174Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 232, partNo: 0, Offset: 231 is stored on disk
2025-10-01T14:07:05.001176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 233, partNo: 0, Offset: 232 is stored on disk
2025-10-01T14:07:05.064979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 175 offsets: 174 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.064987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 175
2025-10-01T14:07:05.001181Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 234, partNo: 0, Offset: 233 is stored on disk
2025-10-01T14:07:05.001186Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 235, partNo: 0, Offset: 234 is stored on disk
2025-10-01T14:07:05.065002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 176 offsets: 175 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.065010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 176
2025-10-01T14:07:05.001191Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 236, partNo: 0, Offset: 235 is stored on disk
2025-10-01T14:07:05.001220Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 237, partNo: 0, Offset: 236 is stored on disk
2025-10-01T14:07:05.065024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 177 offsets: 176 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001226Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.065028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 177
2025-10-01T14:07:05.001231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 238, partNo: 0, Offset: 237 is stored on disk
2025-10-01T14:07:05.001233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001237Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 239, partNo: 0, Offset: 238 is stored on disk
2025-10-01T14:07:05.065045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 178 offsets: 177 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.065049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 178
2025-10-01T14:07:05.001243Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 240, partNo: 0, Offset: 239 is stored on disk
2025-10-01T14:07:05.001245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001250Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 241, partNo: 0, Offset: 240 is stored on disk
2025-10-01T14:07:05.001252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001256Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 242, partNo: 0, Offset: 241 is stored on disk
2025-10-01T14:07:05.001258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.001262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 243, partNo: 0, Offset: 242 is stored on disk
2025-10-01T14:07:05.065068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 179 offsets: 178 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.065071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 179
2025-10-01T14:07:05.001308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.001311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-01T14:07:05.001331Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 244 partNo 0
2025-10-01T14:07:05.001358Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 244 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 26889 count 1 nextOffset 244 batches 1
2025-10-01T14:07:05.001364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 245 partNo 0
2025-10-01T14:07:05.001369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 245 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 53856 count 2 nextOffset 245 batches 1
2025-10-01T14:07:05.065098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 180 offsets: 179 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
>>> event from dataHandler: 2025-10-01T14:07:05.001372Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 246 partNo 0
2025-10-01T14:07:05.001377Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 246 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 80933 count 3 nextOffset 246 batches 1
2025-10-01T14:07:05.001380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 247 partNo 0
2025-10-01T14:07:05.065102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 180
2025-10-01T14:07:05.001384Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 247 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 108120 count 4 nextOffset 247 batches 1
2025-10-01T14:07:05.001387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 248 partNo 0
2025-10-01T14:07:05.001391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 248 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 135417 count 5 nextOffset 248 batches 1
2025-10-01T14:07:05.001394Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 249 partNo 0
2025-10-01T14:07:05.001398Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 249 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 162824 count 6 nextOffset 249 batches 1
2025-10-01T14:07:05.065128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 181 offsets: 180 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.065139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 181
2025-10-01T14:07:05.001400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 250 partNo 0
2025-10-01T14:07:05.001404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 250 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 190341 count 7 nextOffset 250 batches 1
2025-10-01T14:07:05.001407Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 251 partNo 0
2025-10-01T14:07:05.065154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 182 offsets: 181 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.065161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 182
2025-10-01T14:07:05.001411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 251 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 217968 count 8 nextOffset 251 batches 1
2025-10-01T14:07:05.001413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 252 partNo 0
2025-10-01T14:07:05.001419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 252 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 245705 count 9 nextOffset 252 batches 1
2025-10-01T14:07:05.001422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 253 partNo 0
2025-10-01T14:07:05.065176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 183 offsets: 182 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.001426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 253 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 273552 count 10 nextOffset 253 batches 1
2025-10-01T14:07:05.065180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 183
2025-10-01T14:07:05.001429Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 254 partNo 0
2025-10-01T14:07:05.001432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 254 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 301509 count 11 nextOffset 254 batches 1
2025-10-01T14:07:05.001435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 255 partNo 0
2025-10-01T14:07:05.065195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 184 offsets: 183 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.065203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 184
2025-10-01T14:07:05.001439Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 255 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 329576 count 12 nextOffset 255 batches 1
2025-10-01T14:07:05.001442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 256 partNo 0
2025-10-01T14:07:05.001446Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 256 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 357753 count 13 nextOffset 256 batches 1
2025-10-01T14:07:05.001449Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 257 partNo 0
2025-10-01T14:07:05.065218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 185 offsets: 184 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.065225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 185
2025-10-01T14:07:05.001452Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 257 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 386040 count 14 nextOffset 257 batches 1
2025-10-01T14:07:05.001455Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 258 partNo 0
2025-10-01T14:07:05.001459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 258 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 414437 count 15 nextOffset 258 batches 1
2025-10-01T14:07:05.001462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 259 partNo 0
2025-10-01T14:07:05.065240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 186 offsets: 185 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..17391 bytes.. Information: { Offset: 158 ProducerId: "src_id" SeqNo: 159 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.981000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17501 bytes.. Information: { Offset: 159 ProducerId: "src_id" SeqNo: 160 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.981000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17611 bytes.. Information: { Offset: 160 ProducerId: "src_id" SeqNo: 161 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.981000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17721 bytes.. Information: { Offset: 161 ProducerId: "src_id" SeqNo: 162 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.981000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17831 bytes.. Information: { Offset: 162 ProducerId: "src_id" SeqNo: 163 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.981000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17941 bytes.. Information: { Offset: 163 ProducerId: "src_id" SeqNo: 164 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18051 bytes.. Information: { Offset: 164 ProducerId: "src_id" SeqNo: 165 CreateTime: 2025-10-01T14:07:04.957000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18161 bytes.. Information: { Offset: 165 ProducerId: "src_id" SeqNo: 166 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18271 bytes.. Information: { Offset: 166 ProducerId: "src_id" SeqNo: 167 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18381 bytes.. Information: { Offset: 167 ProducerId: "src_id" SeqNo: 168 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18491 bytes.. Information: { Offset: 168 ProducerId: "src_id" SeqNo: 169 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18601 bytes.. Information: { Offset: 169 ProducerId: "src_id" SeqNo: 170 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18711 bytes.. Information: { Offset: 170 ProducerId: "src_id" SeqNo: 171 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18821 bytes.. Information: { Offset: 171 ProducerId: "src_id" SeqNo: 172 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18931 bytes.. Information: { Offset: 172 ProducerId: "src_id" SeqNo: 173 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19041 bytes.. Information: { Offset: 173 ProducerId: "src_id" SeqNo: 174 CreateTime: 2025-10-01T14:07:04.958000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19151 bytes.. Information: { Offset: 174 ProducerId: "src_id" SeqNo: 175 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19261 bytes.. Information: { Offset: 175 ProducerId: "src_id" SeqNo: 176 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19371 bytes.. Information: { Offset: 176 ProducerId: "src_id" SeqNo: 177 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19481 bytes.. Information: { Offset: 177 ProducerId: "src_id" SeqNo: 178 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19591 bytes.. Information: { Offset: 178 ProducerId: "src_id" SeqNo: 179 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19701 bytes.. Information: { Offset: 179 ProducerId: "src_id" SeqNo: 180 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19811 bytes.. Information: { Offset: 180 ProducerId: "src_id" SeqNo: 181 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19921 bytes.. Information: { Offset: 181 ProducerId: "src_id" SeqNo: 182 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20031 bytes.. Information: { Offset: 182 ProducerId: "src_id" SeqNo: 183 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20141 bytes.. Information: { Offset: 183 ProducerId: "src_id" SeqNo: 184 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20251 bytes.. Information: { Offset: 184 ProducerId: "src_id" SeqNo: 185 CreateTime: 2025-10-01T14:07:04.959000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20361 bytes.. Information: { Offset: 185 ProducerId: "src_id" SeqNo: 186 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.065248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 186
2025-10-01T14:07:05.001466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 259 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 442944 count 16 nextOffset 259 batches 1
2025-10-01T14:07:05.001469Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 260 partNo 0
2025-10-01T14:07:05.001474Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 260 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 471561 count 17 nextOffset 260 batches 1
2025-10-01T14:07:05.001476Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 261 partNo 0
2025-10-01T14:07:05.001479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 261 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 500288 count 18 nextOffset 261 batches 1
2025-10-01T14:07:05.001482Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 262 partNo 0
2025-10-01T14:07:05.001822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 262 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 528600 count 19 nextOffset 262 batches 1
2025-10-01T14:07:05.001832Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 263 partNo 0
2025-10-01T14:07:05.001847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 263 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 557579 count 20 nextOffset 263 batches 2
2025-10-01T14:07:05.001850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.001915Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 243,20 HeadOffset 243 endOffset 243 curOffset 263 d0000000000_00000000000000000243_00000_0000000020_00000? size 557570 WTime 1759327625001
2025-10-01T14:07:05.002004Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:05.002006Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:05.002009Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:05.002012Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:05.002014Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:05.002016Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:05.002019Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:05.002020Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000123_00000_0000000080_00000?
2025-10-01T14:07:05.002023Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000203_00000_0000000020_00000?
2025-10-01T14:07:05.002025Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000223_00000_0000000020_00000?
2025-10-01T14:07:05.002028Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 10 keys were taken away. Let's read 3258414 bytes (3258414)
2025-10-01T14:07:05.002031Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 10, size 3258414 (8388608)
2025-10-01T14:07:05.002048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 451  requestId: <none> cookie: 224
2025-10-01T14:07:05.002068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 452  requestId: <none> cookie: 225
2025-10-01T14:07:05.002073Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 453  requestId: <none> cookie: 226
2025-10-01T14:07:05.002079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 454  requestId: <none> cookie: 227
2025-10-01T14:07:05.002086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 455  requestId: <none> cookie: 228
2025-10-01T14:07:05.002095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 461  requestId: <none> cookie: 229
2025-10-01T14:07:05.002101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 462  requestId: <none> cookie: 230
2025-10-01T14:07:05.002107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 463  requestId: <none> cookie: 231
2025-10-01T14:07:05.074620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 187 offsets: 186 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.002113Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 464  requestId: <none> cookie: 232
2025-10-01T14:07:05.074631Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 28, size 528528 bytes
2025-10-01T14:07:05.002120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 465  requestId: <none> cookie: 233
2025-10-01T14:07:05.074641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 187
2025-10-01T14:07:05.002126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 471  requestId: <none> cookie: 234
2025-10-01T14:07:05.002132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 472  requestId: <none> cookie: 235
2025-10-01T14:07:05.002138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 473  requestId: <none> cookie: 236
2025-10-01T14:07:05.002145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 474  requestId: <none> cookie: 237
2025-10-01T14:07:05.002167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.002180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 264 partNo : 0 messageNo: 531 size 29015 offset: -1
2025-10-01T14:07:05.002187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 475  requestId: <none> cookie: 238
2025-10-01T14:07:05.002220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002222Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.002226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 265 partNo : 0 messageNo: 532 size 29125 offset: -1
2025-10-01T14:07:05.074682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 188 offsets: 187 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 188
2025-10-01T14:07:05.002231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 481  requestId: <none> cookie: 239
2025-10-01T14:07:05.002238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 482  requestId: <none> cookie: 240
2025-10-01T14:07:05.002245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 483  requestId: <none> cookie: 241
2025-10-01T14:07:05.002261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.074708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 189 offsets: 188 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 189
2025-10-01T14:07:05.074707Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (186-202)
2025-10-01T14:07:05.074727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 190 offsets: 189 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 190
2025-10-01T14:07:05.074764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 191 offsets: 190 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 191
2025-10-01T14:07:05.002263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 192 offsets: 191 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 192
2025-10-01T14:07:05.074733Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.002266Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 266 partNo : 0 messageNo: 533 size 29235 offset: -1
2025-10-01T14:07:05.002272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 484  requestId: <none> cookie: 242
2025-10-01T14:07:05.002282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 485  requestId: <none> cookie: 243
2025-10-01T14:07:05.074802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 193 offsets: 192 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.002296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.074826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 193
2025-10-01T14:07:05.002297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074837Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 23} (186-186)
2025-10-01T14:07:05.002301Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 267 partNo : 0 messageNo: 534 size 29345 offset: -1
2025-10-01T14:07:05.002420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074845Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (203-225)
2025-10-01T14:07:05.074853Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 24} (187-187)
2025-10-01T14:07:05.074856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 194 offsets: 193 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 194
2025-10-01T14:07:05.002426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 268 partNo : 0 messageNo: 535 size 29455 offset: -1
2025-10-01T14:07:05.074867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 25} (188-188)
2025-10-01T14:07:05.002435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074863Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 567756 to budget
2025-10-01T14:07:05.074874Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 26} (189-189)
2025-10-01T14:07:05.002443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074904Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 27} (190-190)
2025-10-01T14:07:05.074875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 195 offsets: 194 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.002450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.074911Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 28} (191-191)
2025-10-01T14:07:05.002451Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 195
2025-10-01T14:07:05.074879Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 567756, ReadSizeServerDelta = -43468
2025-10-01T14:07:05.074916Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 29} (192-192)
2025-10-01T14:07:05.074921Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 30} (193-193)
2025-10-01T14:07:05.002456Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.002463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.074935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 196 offsets: 195 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.074938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 196
2025-10-01T14:07:05.002472Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:05.002486Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 243 partNo 0 count 20 size 557570
2025-10-01T14:07:05.002494Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.074950Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 31} (194-194)
2025-10-01T14:07:05.002501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.074954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 197 offsets: 196 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.002503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.002506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.074963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 197
2025-10-01T14:07:05.002508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.002511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.074955Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 32} (195-195)
2025-10-01T14:07:05.002513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.074984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 198 offsets: 197 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.002516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.074987Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 33} (196-196)
2025-10-01T14:07:05.074988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 198
2025-10-01T14:07:05.002517Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.074995Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 34} (197-197)
2025-10-01T14:07:05.002520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.002569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 536  requestId: <none> cookie: 269
2025-10-01T14:07:05.002579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 537  requestId: <none> cookie: 270
2025-10-01T14:07:05.075003Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 35} (198-198)
2025-10-01T14:07:05.002582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 538  requestId: <none> cookie: 271
2025-10-01T14:07:05.002585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 539  requestId: <none> cookie: 272
2025-10-01T14:07:05.075010Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 36} (199-199)
2025-10-01T14:07:05.002587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 540  requestId: <none> cookie: 273
2025-10-01T14:07:05.002862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075018Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 37} (200-200)
2025-10-01T14:07:05.002875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.002901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 269 partNo : 0 messageNo: 541 size 29565 offset: -1
2025-10-01T14:07:05.075027Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 38} (201-201)
2025-10-01T14:07:05.002933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.002940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 270 partNo : 0 messageNo: 542 size 29675 offset: -1
2025-10-01T14:07:05.075036Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:05.002973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.002975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.002979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 271 partNo : 0 messageNo: 543 size 29785 offset: -1
2025-10-01T14:07:05.003052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 272 partNo : 0 messageNo: 544 size 29895 offset: -1
2025-10-01T14:07:05.003092Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 273 partNo : 0 messageNo: 545 size 30005 offset: -1
2025-10-01T14:07:05.003106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 199 offsets: 198 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.003192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003194Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 199
2025-10-01T14:07:05.003198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075101Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 39} (202-202)
2025-10-01T14:07:05.003204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 200 offsets: 199 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.003230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003232Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 200
2025-10-01T14:07:05.075127Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (203-203)
2025-10-01T14:07:05.003236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.075149Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (204-204)
2025-10-01T14:07:05.003239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075156Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (205-205)
2025-10-01T14:07:05.003242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.075151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 201 offsets: 200 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.003243Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 201
2025-10-01T14:07:05.075163Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (206-206)
2025-10-01T14:07:05.003245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003247Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075177Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (207-207)
2025-10-01T14:07:05.003252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 546  requestId: <none> cookie: 274
2025-10-01T14:07:05.075183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 202 offsets: 201 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.075191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 202
2025-10-01T14:07:05.075184Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (208-208)
2025-10-01T14:07:05.003287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 547  requestId: <none> cookie: 275
2025-10-01T14:07:05.075202Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (209-209)
2025-10-01T14:07:05.003289Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 548  requestId: <none> cookie: 276
2025-10-01T14:07:05.075206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 203 offsets: 202 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.003292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 549  requestId: <none> cookie: 277
2025-10-01T14:07:05.075209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 203
2025-10-01T14:07:05.075210Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (210-210)
2025-10-01T14:07:05.003295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 550  requestId: <none> cookie: 278
2025-10-01T14:07:05.003661Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075225Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (211-211)
2025-10-01T14:07:05.003663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 204 offsets: 203 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.003669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 274 partNo : 0 messageNo: 551 size 30115 offset: -1
2025-10-01T14:07:05.075233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 204
2025-10-01T14:07:05.003704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003709Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 275 partNo : 0 messageNo: 552 size 30225 offset: -1
2025-10-01T14:07:05.075233Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (212-212)
2025-10-01T14:07:05.075253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 205 offsets: 204 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.075256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 205
2025-10-01T14:07:05.003723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 276 partNo : 0 messageNo: 553 size 30335 offset: -1
2025-10-01T14:07:05.075224Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 567756 } }
2025-10-01T14:07:05.075272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 206 offsets: 205 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.075286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 206
2025-10-01T14:07:05.075271Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (213-213)
2025-10-01T14:07:05.003765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075295Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (214-214)
2025-10-01T14:07:05.075302Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (215-215)
2025-10-01T14:07:05.075303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 207 offsets: 206 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.003766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 207
2025-10-01T14:07:05.075308Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (216-216)
2025-10-01T14:07:05.003772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 277 partNo : 0 messageNo: 554 size 30445 offset: -1
2025-10-01T14:07:05.075315Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (217-217)
2025-10-01T14:07:05.075299Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 1601013f-2feda704-f9f7eb9-3e8e02b7
2025-10-01T14:07:05.003792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075324Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# eeb202a7-3729899e-345a27e1-cf7bf35d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 87, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:05.075332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 208 offsets: 207 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.075335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 208
2025-10-01T14:07:05.003794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 278 partNo : 0 messageNo: 555 size 30555 offset: -1
2025-10-01T14:07:05.075350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 209 offsets: 208 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.003807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 209
2025-10-01T14:07:05.003808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.003820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 210 offsets: 209 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.003826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 210
2025-10-01T14:07:05.003830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075359Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 87 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 227 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid eeb202a7-3729899e-345a27e1-cf7bf35d
2025-10-01T14:07:05.003832Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.003836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.003842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.075405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 211 offsets: 210 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.003844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 211
2025-10-01T14:07:05.003847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003849Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.003853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 212 offsets: 211 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 212
2025-10-01T14:07:05.003857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.003861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.003888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 556  requestId: <none> cookie: 279
2025-10-01T14:07:05.075444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 213 offsets: 212 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 213
2025-10-01T14:07:05.003900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 557  requestId: <none> cookie: 280
2025-10-01T14:07:05.004225Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 558  requestId: <none> cookie: 281
2025-10-01T14:07:05.004238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 559  requestId: <none> cookie: 282
2025-10-01T14:07:05.075464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 214 offsets: 213 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.004241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 560  requestId: <none> cookie: 283
2025-10-01T14:07:05.075467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 214
2025-10-01T14:07:05.004278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004281Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 279 partNo : 0 messageNo: 561 size 30665 offset: -1
2025-10-01T14:07:05.004313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004314Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 215 offsets: 214 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 215
2025-10-01T14:07:05.004321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 280 partNo : 0 messageNo: 562 size 30775 offset: -1
2025-10-01T14:07:05.004325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075484Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (218-218)
2025-10-01T14:07:05.075509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 216 offsets: 215 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 216
2025-10-01T14:07:05.075516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (219-219)
2025-10-01T14:07:05.004327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075523Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (220-220)
2025-10-01T14:07:05.004333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004341Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 217 offsets: 216 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.004348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.004350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 217
2025-10-01T14:07:05.004353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.075531Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (221-221)
2025-10-01T14:07:05.004358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 563  requestId: <none> cookie: 284
2025-10-01T14:07:05.004362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 564  requestId: <none> cookie: 285
2025-10-01T14:07:05.075553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 218 offsets: 217 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.004393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004394Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 218
2025-10-01T14:07:05.004398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 281 partNo : 0 messageNo: 565 size 30885 offset: -1
2025-10-01T14:07:05.075553Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (222-222)
2025-10-01T14:07:05.004401Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.004403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.004435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075572Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (223-223)
2025-10-01T14:07:05.004436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 282 partNo : 0 messageNo: 566 size 30995 offset: -1
2025-10-01T14:07:05.075579Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (224-224)
2025-10-01T14:07:05.004470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 219 offsets: 218 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.004471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075585Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (225-225)
2025-10-01T14:07:05.075585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 219
2025-10-01T14:07:05.004474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 283 partNo : 0 messageNo: 567 size 31105 offset: -1
2025-10-01T14:07:05.004478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.004481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.004485Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 220 offsets: 219 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 220
2025-10-01T14:07:05.004493Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004530Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 221 offsets: 220 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 221
2025-10-01T14:07:05.004531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 284 partNo : 0 messageNo: 571 size 31215 offset: -1
2025-10-01T14:07:05.004538Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.004540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.004570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 222 offsets: 221 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 222
2025-10-01T14:07:05.004572Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 285 partNo : 0 messageNo: 572 size 31325 offset: -1
2025-10-01T14:07:05.004583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.004584Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.075671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 223 offsets: 222 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-01T14:07:05.075677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 223
2025-10-01T14:07:05.004589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.004594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.004598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.004602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 568  requestId: <none> cookie: 286
2025-10-01T14:07:05.004613Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.075694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 224 offsets: 223 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.075698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 224
2025-10-01T14:07:05.004617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 569  requestId: <none> cookie: 287
2025-10-01T14:07:05.004620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 570  requestId: <none> cookie: 288
2025-10-01T14:07:05.004625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 573  requestId: <none> cookie: 289
2025-10-01T14:07:05.004628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 574  requestId: <none> cookie: 290
2025-10-01T14:07:05.075714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 225 offsets: 224 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004799Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 243 count 20 size 557570 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:05.004816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:05.075716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 225
2025-10-01T14:07:05.004849Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 557340 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:05.004851Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 243 partno 0 count 20 parts 0 suffix '63' size 557570
2025-10-01T14:07:05.004858Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004866Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 244, partNo: 0, Offset: 243 is stored on disk
2025-10-01T14:07:05.004870Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.075740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 226 offsets: 225 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 245, partNo: 0, Offset: 244 is stored on disk
2025-10-01T14:07:05.075743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 226
2025-10-01T14:07:05.004875Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004879Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 246, partNo: 0, Offset: 245 is stored on disk
2025-10-01T14:07:05.004881Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004884Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 247, partNo: 0, Offset: 246 is stored on disk
2025-10-01T14:07:05.004886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.075759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 227 offsets: 226 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 248, partNo: 0, Offset: 247 is stored on disk
2025-10-01T14:07:05.075762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 227
2025-10-01T14:07:05.004892Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004896Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 249, partNo: 0, Offset: 248 is stored on disk
2025-10-01T14:07:05.004897Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004903Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 250, partNo: 0, Offset: 249 is stored on disk
2025-10-01T14:07:05.004905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 251, partNo: 0, Offset: 250 is stored on disk
2025-10-01T14:07:05.075779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 228 offsets: 227 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.075782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 228
2025-10-01T14:07:05.004911Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004915Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 252, partNo: 0, Offset: 251 is stored on disk
2025-10-01T14:07:05.004916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.075798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 229 offsets: 228 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.075809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 229
2025-10-01T14:07:05.004920Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 253, partNo: 0, Offset: 252 is stored on disk
2025-10-01T14:07:05.004922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004926Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 254, partNo: 0, Offset: 253 is stored on disk
2025-10-01T14:07:05.004928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 255, partNo: 0, Offset: 254 is stored on disk
2025-10-01T14:07:05.075826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 230 offsets: 229 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004933Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.075829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 230
2025-10-01T14:07:05.004936Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 256, partNo: 0, Offset: 255 is stored on disk
2025-10-01T14:07:05.004939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 257, partNo: 0, Offset: 256 is stored on disk
2025-10-01T14:07:05.004947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004950Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 258, partNo: 0, Offset: 257 is stored on disk
2025-10-01T14:07:05.004952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.075845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 231 offsets: 230 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 259, partNo: 0, Offset: 258 is stored on disk
2025-10-01T14:07:05.075848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 231
2025-10-01T14:07:05.004958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 260, partNo: 0, Offset: 259 is stored on disk
2025-10-01T14:07:05.004964Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 261, partNo: 0, Offset: 260 is stored on disk
2025-10-01T14:07:05.004969Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.075865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 232 offsets: 231 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.004974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 262, partNo: 0, Offset: 261 is stored on disk
2025-10-01T14:07:05.075868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 232
2025-10-01T14:07:05.004976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.004979Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 263, partNo: 0, Offset: 262 is stored on disk
2025-10-01T14:07:05.005010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.005027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.005029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (22)
2025-10-01T14:07:05.075884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 233 offsets: 232 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.005058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 264 partNo 0
2025-10-01T14:07:05.075887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 233
2025-10-01T14:07:05.005088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 264 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 29089 count 1 nextOffset 264 batches 1
2025-10-01T14:07:05.005094Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 265 partNo 0
2025-10-01T14:07:05.005099Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 265 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 58256 count 2 nextOffset 265 batches 1
2025-10-01T14:07:05.005102Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 266 partNo 0
2025-10-01T14:07:05.005105Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 266 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 87533 count 3 nextOffset 266 batches 1
2025-10-01T14:07:05.075904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 234 offsets: 233 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.005108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 267 partNo 0
2025-10-01T14:07:05.075907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 234
2025-10-01T14:07:05.005111Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 267 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 116920 count 4 nextOffset 267 batches 1
2025-10-01T14:07:05.005114Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 268 partNo 0
2025-10-01T14:07:05.005118Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 268 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 146417 count 5 nextOffset 268 batches 1
2025-10-01T14:07:05.005120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 269 partNo 0
2025-10-01T14:07:05.005123Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 269 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 176024 count 6 nextOffset 269 batches 1
2025-10-01T14:07:05.005126Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 270 partNo 0
2025-10-01T14:07:05.075922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 235 offsets: 234 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.005130Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 270 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 205741 count 7 nextOffset 270 batches 1
2025-10-01T14:07:05.075936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 235
2025-10-01T14:07:05.005133Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 271 partNo 0
2025-10-01T14:07:05.005136Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 271 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 235568 count 8 nextOffset 271 batches 1
2025-10-01T14:07:05.005140Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 272 partNo 0
2025-10-01T14:07:05.005144Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 272 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 265505 count 9 nextOffset 272 batches 1
2025-10-01T14:07:05.005147Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 273 partNo 0
2025-10-01T14:07:05.075955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 236 offsets: 235 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.075961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 236
2025-10-01T14:07:05.005151Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 273 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 295552 count 10 nextOffset 273 batches 1
2025-10-01T14:07:05.005154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 274 partNo 0
2025-10-01T14:07:05.005157Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 274 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 325709 count 11 nextOffset 274 batches 1
2025-10-01T14:07:05.005160Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 275 partNo 0
2025-10-01T14:07:05.005163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 275 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 355976 count 12 nextOffset 275 batches 1
2025-10-01T14:07:05.075979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 237 offsets: 236 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.075982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 237
2025-10-01T14:07:05.005166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 276 partNo 0
2025-10-01T14:07:05.005169Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 276 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 386353 count 13 nextOffset 276 batches 1
2025-10-01T14:07:05.005171Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 277 partNo 0
2025-10-01T14:07:05.005175Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 277 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 416840 count 14 nextOffset 277 batches 1
2025-10-01T14:07:05.075998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 238 offsets: 237 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 5 }
2025-10-01T14:07:05.005177Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 278 partNo 0
2025-10-01T14:07:05.076001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 238
2025-10-01T14:07:05.005180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 278 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 447437 count 15 nextOffset 278 batches 1
2025-10-01T14:07:05.005182Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 279 partNo 0
2025-10-01T14:07:05.005186Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 279 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 478144 count 16 nextOffset 279 batches 1
2025-10-01T14:07:05.005188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 280 partNo 0
2025-10-01T14:07:05.005194Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 280 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 508961 count 17 nextOffset 280 batches 1
2025-10-01T14:07:05.005197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 281 partNo 0
2025-10-01T14:07:05.076019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 239 offsets: 238 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.005972Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 281 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 539394 count 18 nextOffset 281 batches 1
2025-10-01T14:07:05.076022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 239
2025-10-01T14:07:05.005984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 282 partNo 0
2025-10-01T14:07:05.006001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 282 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 570463 count 19 nextOffset 282 batches 2
2025-10-01T14:07:05.006005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 283 partNo 0
2025-10-01T14:07:05.006009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 283 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 601610 count 20 nextOffset 283 batches 2
2025-10-01T14:07:05.006012Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 284 partNo 0
2025-10-01T14:07:05.076038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 240 offsets: 239 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.076041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 240
2025-10-01T14:07:05.006015Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 284 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 632867 count 21 nextOffset 284 batches 2
2025-10-01T14:07:05.006018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 285 partNo 0
2025-10-01T14:07:05.006023Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 285 partNo 0 FormedBlobsCount 0 NewHead: Offset 263 PartNo 0 PackedSize 664234 count 22 nextOffset 285 batches 2
2025-10-01T14:07:05.006025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.006128Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 263,22 HeadOffset 263 endOffset 263 curOffset 285 d0000000000_00000000000000000263_00000_0000000022_00000? size 664174 WTime 1759327625004
2025-10-01T14:07:05.006407Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:05.076057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 241 offsets: 240 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.006410Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:05.006413Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:05.076059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 241
2025-10-01T14:07:05.006419Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:05.006421Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:05.006423Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:05.006425Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:05.076090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 242 offsets: 241 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.076096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 242
2025-10-01T14:07:05.006427Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000123_00000_0000000080_00000?
2025-10-01T14:07:05.006432Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000203_00000_0000000020_00000?
2025-10-01T14:07:05.006434Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000223_00000_0000000020_00000?
2025-10-01T14:07:05.006436Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000243_00000_0000000020_00000?
2025-10-01T14:07:05.006439Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 11 keys were taken away. Let's read 3815984 bytes (3815984)
2025-10-01T14:07:05.006443Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 11, size 3815984 (8388608)
2025-10-01T14:07:05.006467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 491  requestId: <none> cookie: 244
2025-10-01T14:07:05.006500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 492  requestId: <none> cookie: 245
2025-10-01T14:07:05.076117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 243 offsets: 242 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.006506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 493  requestId: <none> cookie: 246
2025-10-01T14:07:05.076129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 243
2025-10-01T14:07:05.006512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 494  requestId: <none> cookie: 247
2025-10-01T14:07:05.006518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 495  requestId: <none> cookie: 248
2025-10-01T14:07:05.006524Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 501  requestId: <none> cookie: 249
2025-10-01T14:07:05.006550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.006554Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.006564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 286 partNo : 0 messageNo: 575 size 31435 offset: -1
2025-10-01T14:07:05.076149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 244 offsets: 243 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 502  requestId: <none> cookie: 250
2025-10-01T14:07:05.076153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 244
2025-10-01T14:07:05.006591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.006592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.006596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 287 partNo : 0 messageNo: 576 size 31545 offset: -1
2025-10-01T14:07:05.006601Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 503  requestId: <none> cookie: 251
2025-10-01T14:07:05.006627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.076168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 245 offsets: 244 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.076172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 245
2025-10-01T14:07:05.006633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 288 partNo : 0 messageNo: 577 size 31655 offset: -1
2025-10-01T14:07:05.006652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.006654Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-10-01T14:07:05.076190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 246 offsets: 245 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.076193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 246
2025-10-01T14:07:05.006657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 289 partNo : 0 messageNo: 578 size 31765 offset: -1
2025-10-01T14:07:05.006663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 504  requestId: <none> cookie: 252
2025-10-01T14:07:05.006677Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 505  requestId: <none> cookie: 253
2025-10-01T14:07:05.006682Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 511  requestId: <none> cookie: 254
2025-10-01T14:07:05.076209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 247 offsets: 246 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.076212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 247
2025-10-01T14:07:05.006705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.006709Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 290 partNo : 0 messageNo: 579 size 31875 offset: -1
2025-10-01T14:07:05.006714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 512  requestId: <none> cookie: 255
2025-10-01T14:07:05.006726Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 513  requestId: <none> cookie: 256
2025-10-01T14:07:05.006732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 514  requestId: <none> cookie: 257
2025-10-01T14:07:05.076229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 248 offsets: 247 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006738Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 515  requestId: <none> cookie: 258
2025-10-01T14:07:05.076231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 248
2025-10-01T14:07:05.006744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 521  requestId: <none> cookie: 259
2025-10-01T14:07:05.006751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.006752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.006757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.006759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.076247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 249 offsets: 248 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.076250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 249
2025-10-01T14:07:05.006763Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.006768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 522  requestId: <none> cookie: 260
2025-10-01T14:07:05.006778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.006779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.006783Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.076266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 250 offsets: 249 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.076270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 250
2025-10-01T14:07:05.006790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 523  requestId: <none> cookie: 261
2025-10-01T14:07:05.006797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 524  requestId: <none> cookie: 262
2025-10-01T14:07:05.006804Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 525  requestId: <none> cookie: 263
2025-10-01T14:07:05.006813Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:05.006827Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 263 partNo 0 count 22 size 664174
2025-10-01T14:07:05.006834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.006841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.076285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 251 offsets: 250 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.076297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 251
2025-10-01T14:07:05.006846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.006847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.006850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.006851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.006853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.006855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.006857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.076317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 252 offsets: 251 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.006899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 580  requestId: <none> cookie: 291
2025-10-01T14:07:05.076320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 252
2025-10-01T14:07:05.006914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 581  requestId: <none> cookie: 292
2025-10-01T14:07:05.006916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 582  requestId: <none> cookie: 293
2025-10-01T14:07:05.006919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 583  requestId: <none> cookie: 294
2025-10-01T14:07:05.006922Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 584  requestId: <none> cookie: 295
2025-10-01T14:07:05.007158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007182Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 291 partNo : 0 messageNo: 585 size 31985 offset: -1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..20471 bytes.. Information: { Offset: 186 ProducerId: "src_id" SeqNo: 187 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20581 bytes.. Information: { Offset: 187 ProducerId: "src_id" SeqNo: 188 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20691 bytes.. Information: { Offset: 188 ProducerId: "src_id" SeqNo: 189 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20801 bytes.. Information: { Offset: 189 ProducerId: "src_id" SeqNo: 190 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20911 bytes.. Information: { Offset: 190 ProducerId: "src_id" SeqNo: 191 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21021 bytes.. Information: { Offset: 191 ProducerId: "src_id" SeqNo: 192 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21131 bytes.. Information: { Offset: 192 ProducerId: "src_id" SeqNo: 193 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21241 bytes.. Information: { Offset: 193 ProducerId: "src_id" SeqNo: 194 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21351 bytes.. Information: { Offset: 194 ProducerId: "src_id" SeqNo: 195 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21461 bytes.. Information: { Offset: 195 ProducerId: "src_id" SeqNo: 196 CreateTime: 2025-10-01T14:07:04.960000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21571 bytes.. Information: { Offset: 196 ProducerId: "src_id" SeqNo: 197 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21681 bytes.. Information: { Offset: 197 ProducerId: "src_id" SeqNo: 198 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21791 bytes.. Information: { Offset: 198 ProducerId: "src_id" SeqNo: 199 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21901 bytes.. Information: { Offset: 199 ProducerId: "src_id" SeqNo: 200 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22011 bytes.. Information: { Offset: 200 ProducerId: "src_id" SeqNo: 201 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22121 bytes.. Information: { Offset: 201 ProducerId: "src_id" SeqNo: 202 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22231 bytes.. Information: { Offset: 202 ProducerId: "src_id" SeqNo: 203 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.982000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22341 bytes.. Information: { Offset: 203 ProducerId: "src_id" SeqNo: 204 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22451 bytes.. Information: { Offset: 204 ProducerId: "src_id" SeqNo: 205 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22561 bytes.. Information: { Offset: 205 ProducerId: "src_id" SeqNo: 206 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22671 bytes.. Information: { Offset: 206 ProducerId: "src_id" SeqNo: 207 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22781 bytes.. Information: { Offset: 207 ProducerId: "src_id" SeqNo: 208 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22891 bytes.. Information: { Offset: 208 ProducerId: "src_id" SeqNo: 209 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23001 bytes.. Information: { Offset: 209 ProducerId: "src_id" SeqNo: 210 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23111 bytes.. Information: { Offset: 210 ProducerId: "src_id" SeqNo: 211 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23221 bytes.. Information: { Offset: 211 ProducerId: "src_id" SeqNo: 212 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23331 bytes.. Information: { Offset: 212 ProducerId: "src_id" SeqNo: 213 CreateTime: 2025-10-01T14:07:04.961000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23441 bytes.. Information: { Offset: 213 ProducerId: "src_id" SeqNo: 214 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23551 bytes.. Information: { Offset: 214 ProducerId: "src_id" SeqNo: 215 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23661 bytes.. Information: { Offset: 215 ProducerId: "src_id" SeqNo: 216 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23771 bytes.. Information: { Offset: 216 ProducerId: "src_id" SeqNo: 217 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23881 bytes.. Information: { Offset: 217 ProducerId: "src_id" SeqNo: 218 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23991 bytes.. Information: { Offset: 218 ProducerId: "src_id" SeqNo: 219 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24101 bytes.. Information: { Offset: 219 ProducerId: "src_id" SeqNo: 220 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24211 bytes.. Information: { Offset: 220 ProducerId: "src_id" SeqNo: 221 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24321 bytes.. Information: { Offset: 221 ProducerId: "src_id" SeqNo: 222 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24431 bytes.. Information: { Offset: 222 ProducerId: "src_id" SeqNo: 223 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.986000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24541 bytes.. Information: { Offset: 223 ProducerId: "src_id" SeqNo: 224 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24651 bytes.. Information: { Offset: 224 ProducerId: "src_id" SeqNo: 225 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24761 bytes.. Information: { Offset: 225 ProducerId: "src_id" SeqNo: 226 CreateTime: 2025-10-01T14:07:04.962000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }2025-10-01T14:07:05.076337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 253 offsets: 252 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.007205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.076359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 253
2025-10-01T14:07:05.007213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 292 partNo : 0 messageNo: 586 size 32095 offset: -1
2025-10-01T14:07:05.007232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 293 partNo : 0 messageNo: 587 size 32205 offset: -1
2025-10-01T14:07:05.007252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 294 partNo : 0 messageNo: 588 size 32315 offset: -1
2025-10-01T14:07:05.076385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 254 offsets: 253 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.007275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.076388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 254
2025-10-01T14:07:05.007277Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 295 partNo : 0 messageNo: 589 size 32425 offset: -1
2025-10-01T14:07:05.007284Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007285Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.076405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 255 offsets: 254 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.076412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 255
2025-10-01T14:07:05.007294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.076431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 256 offsets: 255 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.076561Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 23, size 541673 bytes
2025-10-01T14:07:05.079856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 256
2025-10-01T14:07:05.078003Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 227 Data: "... 25055 bytes ..." SourceId: "\000src_id" SeqNo: 228 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 24981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 228 Data: "... 25165 bytes ..." SourceId: "\000src_id" SeqNo: 229 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 25091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 229 Data: "... 25275 bytes ..." SourceId: "\000src_id" SeqNo: 230 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 25201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 230 Data: "... 25385 bytes ..." SourceId: "\000src_id" SeqNo: 231 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 25311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 231 Data: "... 25495 bytes ..." SourceId: "\000src_id" SeqNo: 232 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 25421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 232 Data: "... 25605 bytes ..." SourceId: "\000src_id" SeqNo: 233 WriteTimestampMS: 1759327624996 CreateTimestampMS: 1759327624963 UncompressedSize: 25531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 233 Data: "... 25715 bytes ..." SourceId: "\000src_id" SeqNo: 234 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 25641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 234 Data: "... 25825 bytes ..." SourceId: "\000src_id" SeqNo: 235 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 25751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 235 Data: "... 25935 bytes ..." SourceId: "\000src_id" SeqNo: 236 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 25861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 236 Data: "... 26045 bytes ..." SourceId: "\000src_id" SeqNo: 237 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 25971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 237 Data: "... 26155 bytes ..." SourceId: "\000src_id" SeqNo: 238 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 26081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 238 Data: "... 26265 bytes ..." SourceId: "\000src_id" SeqNo: 239 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 26191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 239 Data: "... 26375 bytes ..." SourceId: "\000src_id" SeqNo: 240 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 26301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 240 Data: "... 26485 bytes ..." SourceId: "\000src_id" SeqNo: 241 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 26411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 241 Data: "... 26595 bytes ..." SourceId: "\000src_id" SeqNo: 242 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624964 UncompressedSize: 26521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 242 Data: "... 26705 bytes ..." SourceId: "\000src_id" SeqNo: 243 WriteTimestampMS: 1759327624997 CreateTimestampMS: 1759327624965 UncompressedSize: 26631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 243 Data: "... 26815 bytes ..." SourceId: "\000src_id" SeqNo: 244 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 26741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 244 Data: "... 26925 bytes ..." SourceId: "\000src_id" SeqNo: 245 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 26851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 245 Data: "... 27035 bytes ..." SourceId: "\000src_id" SeqNo: 246 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 26961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 246 Data: "... 27145 bytes ..." SourceId: "\000src_id" SeqNo: 247 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 27071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 247 Data: "... 27255 bytes ..." SourceId: "\000src_id" SeqNo: 248 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 27181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 248 Data: "... 27365 bytes ..." SourceId: "\000src_id" SeqNo: 249 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 27291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 249 Data: "... 27475 bytes ..." SourceId: "\000src_id" SeqNo: 250 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624965 UncompressedSize: 27401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 250 Data: "... 27585 bytes ..." SourceId: "\000src_id" SeqNo: 251 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 27511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 251 Data: "... 27695 bytes ..." SourceId: "\000src_id" SeqNo: 252 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 27621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 252 Data: "... 27805 bytes ..." SourceId: "\000src_id" SeqNo: 253 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 27731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 253 Data: "... 27915 bytes ..." SourceId: "\000src_id" SeqNo: 254 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 27841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 254 Data: "... 28025 bytes ..." SourceId: "\000src_id" SeqNo: 255 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 27951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 255 Data: "... 28135 bytes ..." SourceId: "\000src_id" SeqNo: 256 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 256 Data: "... 28245 bytes ..." SourceId: "\000src_id" SeqNo: 257 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 257 Data: "... 28355 bytes ..." SourceId: "\000src_id" SeqNo: 258 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 258 Data: "... 28465 bytes ..." SourceId: "\000src_id" SeqNo: 259 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 259 Data: "... 28575 bytes ..." SourceId: "\000src_id" SeqNo: 260 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 260 Data: "... 28685 bytes ..." SourceId: "\000src_id" SeqNo: 261 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 261 Data: "... 28795 bytes ..." SourceId: "\000src_id" SeqNo: 262 WriteTimestampMS: 1759327625000 CreateTimestampMS: 1759327624966 UncompressedSize: 28721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 262 Data: "... 28905 bytes ..." SourceId: "\000src_id" SeqNo: 263 WriteTimestampMS: 1759327625001 CreateTimestampMS: 1759327624966 UncompressedSize: 28831 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 1275984 RealReadOffset: 262 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 227 }
2025-10-01T14:07:05.079568Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 970538, now ReadSizeBudget = 0, ReadSizeServerDelta = -446250
2025-10-01T14:07:05.078270Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 263 endOffset 300
2025-10-01T14:07:05.007300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.078287Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 263 ReadGuid eeb202a7-3729899e-345a27e1-cf7bf35d has messages 1
2025-10-01T14:07:05.078312Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 263, endOffset# 300, WTime# 1759327625001, sizeLag# 1275984
2025-10-01T14:07:05.078318Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:07:05.007307Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.078347Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# eeb202a7-3729899e-345a27e1-cf7bf35d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 970538
2025-10-01T14:07:05.007325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.078362Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# eeb202a7-3729899e-345a27e1-cf7bf35d
2025-10-01T14:07:05.079938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 257 offsets: 256 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.079954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 257
2025-10-01T14:07:05.079257Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 1
2025-10-01T14:07:05.007335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.007341Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.079974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 258 offsets: 257 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.007343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.079977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 258
2025-10-01T14:07:05.007345Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.079992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 259 offsets: 258 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.007347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.079994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 259
2025-10-01T14:07:05.007348Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.007364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 590  requestId: <none> cookie: 296
2025-10-01T14:07:05.080014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 260 offsets: 259 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.007379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 591  requestId: <none> cookie: 297
2025-10-01T14:07:05.080018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 260
2025-10-01T14:07:05.007381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 592  requestId: <none> cookie: 298
2025-10-01T14:07:05.079974Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 17, size 362967 bytes
2025-10-01T14:07:05.080033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 261 offsets: 260 already_written: false write_statistics { persist_duration_ms: 3 }
2025-10-01T14:07:05.080041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 261
2025-10-01T14:07:05.007383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 593  requestId: <none> cookie: 299
2025-10-01T14:07:05.007386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 594  requestId: <none> cookie: 300
2025-10-01T14:07:05.007633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.080053Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.080055Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (226-226)
2025-10-01T14:07:05.080067Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.080067Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (227-247)
2025-10-01T14:07:05.007642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 296 partNo : 0 messageNo: 595 size 32535 offset: -1
2025-10-01T14:07:05.080082Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (226-226)
2025-10-01T14:07:05.007659Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.080056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 262 offsets: 261 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.007660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 297 partNo : 0 messageNo: 596 size 32645 offset: -1
2025-10-01T14:07:05.080093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 262
2025-10-01T14:07:05.080078Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 970538 to budget
2025-10-01T14:07:05.080100Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 970538, ReadSizeServerDelta = -446250
2025-10-01T14:07:05.007679Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007682Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.080115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 263 offsets: 262 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.007685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 298 partNo : 0 messageNo: 597 size 32755 offset: -1
2025-10-01T14:07:05.080119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 263
2025-10-01T14:07:05.007728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 299 partNo : 0 messageNo: 598 size 32865 offset: -1
2025-10-01T14:07:05.007737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.080133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 264 offsets: 263 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.080144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 264
2025-10-01T14:07:05.007775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.007776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.007780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 300 partNo : 0 messageNo: 599 size 32975 offset: -1
2025-10-01T14:07:05.007783Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.007787Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.007790Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.080173Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:05.007794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.007797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:05.009638Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 263 count 22 size 664174 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:05.080188Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (227-227)
2025-10-01T14:07:05.009651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:05.009667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 663894 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:05.009677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009685Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 264, partNo: 0, Offset: 263 is stored on disk
2025-10-01T14:07:05.080210Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (228-228)
2025-10-01T14:07:05.009689Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009693Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 265, partNo: 0, Offset: 264 is stored on disk
2025-10-01T14:07:05.009695Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 266, partNo: 0, Offset: 265 is stored on disk
2025-10-01T14:07:05.009699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080229Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (229-229)
2025-10-01T14:07:05.009702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 267, partNo: 0, Offset: 266 is stored on disk
2025-10-01T14:07:05.080234Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (230-230)
2025-10-01T14:07:05.080245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 265 offsets: 264 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.080254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 265
2025-10-01T14:07:05.009704Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009708Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 268, partNo: 0, Offset: 267 is stored on disk
2025-10-01T14:07:05.009711Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 269, partNo: 0, Offset: 268 is stored on disk
2025-10-01T14:07:05.009722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (231-231)
2025-10-01T14:07:05.080276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 266 offsets: 265 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.080281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 266
2025-10-01T14:07:05.080285Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (232-232)
2025-10-01T14:07:05.009725Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 270, partNo: 0, Offset: 269 is stored on disk
2025-10-01T14:07:05.080289Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (233-233)
2025-10-01T14:07:05.009728Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080294Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (234-234)
2025-10-01T14:07:05.080296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 267 offsets: 266 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.009733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 271, partNo: 0, Offset: 270 is stored on disk
>>> event from dataHandler: 2025-10-01T14:07:05.080299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 267
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..24871 bytes.. Information: { Offset: 226 ProducerId: "src_id" SeqNo: 227 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.009735Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 268 offsets: 267 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.080333Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (235-235)
2025-10-01T14:07:05.080338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 268
2025-10-01T14:07:05.080341Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (236-236)
2025-10-01T14:07:05.080346Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (237-237)
2025-10-01T14:07:05.080347Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 1, size 24871 bytes
2025-10-01T14:07:05.080352Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (238-238)
2025-10-01T14:07:05.080357Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.080319Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 970538 } }
2025-10-01T14:07:05.009738Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 272, partNo: 0, Offset: 271 is stored on disk
2025-10-01T14:07:05.009740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009743Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 273, partNo: 0, Offset: 272 is stored on disk
2025-10-01T14:07:05.080358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 269 offsets: 268 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.080391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 269
2025-10-01T14:07:05.009745Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 274, partNo: 0, Offset: 273 is stored on disk
2025-10-01T14:07:05.009751Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080380Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 9bae1764-9a3363a4-ca6ced85-e6b5fe41
2025-10-01T14:07:05.080360Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (239-239)
2025-10-01T14:07:05.080399Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# bf2d8bb5-abb94d46-a595dbdc-45f13647, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 44, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:05.009756Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 275, partNo: 0, Offset: 274 is stored on disk
2025-10-01T14:07:05.009757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080422Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (240-240)
2025-10-01T14:07:05.080430Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (241-241)
2025-10-01T14:07:05.009761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 276, partNo: 0, Offset: 275 is stored on disk
2025-10-01T14:07:05.080408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 270 offsets: 269 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 270
2025-10-01T14:07:05.080436Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (242-242)
2025-10-01T14:07:05.009766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 277, partNo: 0, Offset: 276 is stored on disk
2025-10-01T14:07:05.009768Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 278, partNo: 0, Offset: 277 is stored on disk
2025-10-01T14:07:05.009774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 271 offsets: 270 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009778Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 279, partNo: 0, Offset: 278 is stored on disk
2025-10-01T14:07:05.080467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 271
2025-10-01T14:07:05.009780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 280, partNo: 0, Offset: 279 is stored on disk
2025-10-01T14:07:05.009786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080428Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 44 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 263 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid bf2d8bb5-abb94d46-a595dbdc-45f13647
2025-10-01T14:07:05.009789Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 281, partNo: 0, Offset: 280 is stored on disk
2025-10-01T14:07:05.009791Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 272 offsets: 271 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 282, partNo: 0, Offset: 281 is stored on disk
2025-10-01T14:07:05.080514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 272
2025-10-01T14:07:05.009797Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009800Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 283, partNo: 0, Offset: 282 is stored on disk
2025-10-01T14:07:05.080518Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (243-243)
2025-10-01T14:07:05.009802Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.009806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 284, partNo: 0, Offset: 283 is stored on disk
2025-10-01T14:07:05.080526Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (244-244)
2025-10-01T14:07:05.009808Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.080530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 273 offsets: 272 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 285, partNo: 0, Offset: 284 is stored on disk
2025-10-01T14:07:05.080533Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (245-245)
2025-10-01T14:07:05.009844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.009859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.009861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-01T14:07:05.080533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 273
2025-10-01T14:07:05.009878Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 286 partNo 0
2025-10-01T14:07:05.080551Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (246-246)
2025-10-01T14:07:05.009903Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 286 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 31509 count 1 nextOffset 286 batches 1
2025-10-01T14:07:05.009908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 287 partNo 0
2025-10-01T14:07:05.080565Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (247-247)
2025-10-01T14:07:05.009911Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 287 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 63096 count 2 nextOffset 287 batches 1
2025-10-01T14:07:05.080570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 274 offsets: 273 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 288 partNo 0
2025-10-01T14:07:05.080574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 274
2025-10-01T14:07:05.009916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 288 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 94793 count 3 nextOffset 288 batches 1
2025-10-01T14:07:05.009918Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 289 partNo 0
2025-10-01T14:07:05.009921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 289 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 126600 count 4 nextOffset 289 batches 1
2025-10-01T14:07:05.009922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 290 partNo 0
2025-10-01T14:07:05.009924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 290 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 158517 count 5 nextOffset 290 batches 1
2025-10-01T14:07:05.080591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 275 offsets: 274 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.080600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 275
2025-10-01T14:07:05.009926Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 291 partNo 0
2025-10-01T14:07:05.009929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 291 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 190544 count 6 nextOffset 291 batches 1
2025-10-01T14:07:05.009931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 292 partNo 0
2025-10-01T14:07:05.080615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 276 offsets: 275 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 292 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 222681 count 7 nextOffset 292 batches 1
2025-10-01T14:07:05.080618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 276
2025-10-01T14:07:05.009935Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 293 partNo 0
2025-10-01T14:07:05.009938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 293 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 254928 count 8 nextOffset 293 batches 1
2025-10-01T14:07:05.009939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 294 partNo 0
2025-10-01T14:07:05.009943Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 294 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 287285 count 9 nextOffset 294 batches 1
2025-10-01T14:07:05.080632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 277 offsets: 276 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 295 partNo 0
2025-10-01T14:07:05.080635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 277
2025-10-01T14:07:05.009947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 295 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 319752 count 10 nextOffset 295 batches 1
2025-10-01T14:07:05.009948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 296 partNo 0
2025-10-01T14:07:05.009950Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 296 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 352329 count 11 nextOffset 296 batches 1
2025-10-01T14:07:05.009952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 297 partNo 0
2025-10-01T14:07:05.080660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 278 offsets: 277 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-01T14:07:05.009954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 297 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 385016 count 12 nextOffset 297 batches 1
2025-10-01T14:07:05.080663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 278
2025-10-01T14:07:05.009958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 298 partNo 0
2025-10-01T14:07:05.009960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 298 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 417813 count 13 nextOffset 298 batches 1
2025-10-01T14:07:05.009962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 299 partNo 0
2025-10-01T14:07:05.009964Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 299 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 450720 count 14 nextOffset 299 batches 1
2025-10-01T14:07:05.009965Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 300 partNo 0
2025-10-01T14:07:05.080680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 279 offsets: 278 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.080683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 279
2025-10-01T14:07:05.009968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 300 partNo 0 FormedBlobsCount 0 NewHead: Offset 285 PartNo 0 PackedSize 483737 count 15 nextOffset 300 batches 1
2025-10-01T14:07:05.009969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.010198Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 285,15 HeadOffset 285 endOffset 285 curOffset 300 d0000000000_00000000000000000285_00000_0000000015_00000? size 483336 WTime 1759327625010
2025-10-01T14:07:05.010253Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:05.080698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 280 offsets: 279 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.010255Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:05.080701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 280
2025-10-01T14:07:05.010256Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:05.010258Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:05.010259Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:05.010260Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:05.010263Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:05.080717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 281 offsets: 280 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.010264Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000123_00000_0000000080_00000?
2025-10-01T14:07:05.080721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 281
2025-10-01T14:07:05.010267Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000203_00000_0000000020_00000?
2025-10-01T14:07:05.010269Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000223_00000_0000000020_00000?
2025-10-01T14:07:05.010272Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000243_00000_0000000020_00000?
2025-10-01T14:07:05.010274Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000263_00000_0000000022_00000?
2025-10-01T14:07:05.010277Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 12 keys were taken away. Let's read 4480158 bytes (4480158)
2025-10-01T14:07:05.010280Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 12, size 4480158 (8388608)
2025-10-01T14:07:05.010302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 531  requestId: <none> cookie: 264
2025-10-01T14:07:05.010324Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 532  requestId: <none> cookie: 265
2025-10-01T14:07:05.010329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 533  requestId: <none> cookie: 266
>>> event from dataHandler: 2025-10-01T14:07:05.010334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 534  requestId: <none> cookie: 267
2025-10-01T14:07:05.010340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 535  requestId: <none> cookie: 268
2025-10-01T14:07:05.010345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 541  requestId: <none> cookie: 269
2025-10-01T14:07:05.010347Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 263 partno 0 count 22 parts 0 suffix '63' size 664174
2025-10-01T14:07:05.010351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 542  requestId: <none> cookie: 270
2025-10-01T14:07:05.010357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 543  requestId: <none> cookie: 271
2025-10-01T14:07:05.010362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 544  requestId: <none> cookie: 272
2025-10-01T14:07:05.010368Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 545  requestId: <none> cookie: 273
2025-10-01T14:07:05.010391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 551  requestId: <none> cookie: 274
2025-10-01T14:07:05.010398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 552  requestId: <none> cookie: 275
2025-10-01T14:07:05.010404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 553  requestId: <none> cookie: 276
2025-10-01T14:07:05.010410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 554  requestId: <none> cookie: 277
2025-10-01T14:07:05.010434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 555  requestId: <none> cookie: 278
2025-10-01T14:07:05.010439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 561  requestId: <none> cookie: 279
2025-10-01T14:07:05.010447Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 562  requestId: <none> cookie: 280
2025-10-01T14:07:05.010452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 565  requestId: <none> cookie: 281
2025-10-01T14:07:05.010457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 566  requestId: <none> cookie: 282
2025-10-01T14:07:05.010462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 567  requestId: <none> cookie: 283
2025-10-01T14:07:05.010466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 571  requestId: <none> cookie: 284
2025-10-01T14:07:05.010471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 572  requestId: <none> cookie: 285
2025-10-01T14:07:05.010477Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:05.010486Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 285 partNo 0 count 15 size 483336
2025-10-01T14:07:05.012974Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 285 count 15 size 483336 actorID [4:7556254607918671907:2393]
2025-10-01T14:07:05.012993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:05.013019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 483180 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:05.013019Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 285 partno 0 count 15 parts 0 suffix '63' size 483336
2025-10-01T14:07:05.013026Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..24981 bytes.. Information: { Offset: 227 ProducerId: "src_id" SeqNo: 228 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25091 bytes.. Information: { Offset: 228 ProducerId: "src_id" SeqNo: 229 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25201 bytes.. Information: { Offset: 229 ProducerId: "src_id" SeqNo: 230 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25311 bytes.. Information: { Offset: 230 ProducerId: "src_id" SeqNo: 231 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25421 bytes.. Information: { Offset: 231 ProducerId: "src_id" SeqNo: 232 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25531 bytes.. Information: { Offset: 232 ProducerId: "src_id" SeqNo: 233 CreateTime: 2025-10-01T14:07:04.963000Z WriteTime: 2025-10-01T14:07:04.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25641 bytes.. Information: { Offset: 233 ProducerId: "src_id" SeqNo: 234 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25751 bytes.. Information: { Offset: 234 ProducerId: "src_id" SeqNo: 235 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25861 bytes.. Information: { Offset: 235 ProducerId: "src_id" SeqNo: 236 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25971 bytes.. Information: { Offset: 236 ProducerId: "src_id" SeqNo: 237 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26081 bytes.. Information: { Offset: 237 ProducerId: "src_id" SeqNo: 238 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26191 bytes.. Information: { Offset: 238 ProducerId: "src_id" SeqNo: 239 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26301 bytes.. Information: { Offset: 239 ProducerId: "src_id" SeqNo: 240 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26411 bytes.. Information: { Offset: 240 ProducerId: "src_id" SeqNo: 241 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26521 bytes.. Information: { Offset: 241 ProducerId: "src_id" SeqNo: 242 CreateTime: 2025-10-01T14:07:04.964000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26631 bytes.. Information: { Offset: 242 ProducerId: "src_id" SeqNo: 243 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:04.997000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26741 bytes.. Information: { Offset: 243 ProducerId: "src_id" SeqNo: 244 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26851 bytes.. Information: { Offset: 244 ProducerId: "src_id" SeqNo: 245 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26961 bytes.. Information: { Offset: 245 ProducerId: "src_id" SeqNo: 246 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27071 bytes.. Information: { Offset: 246 ProducerId: "src_id" SeqNo: 247 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27181 bytes.. Information: { Offset: 247 ProducerId: "src_id" SeqNo: 248 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.013033Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 286, partNo: 0, Offset: 285 is stored on disk
2025-10-01T14:07:05.080736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 282 offsets: 281 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.013036Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.082175Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 263 Data: "... 29015 bytes ..." SourceId: "\000src_id" SeqNo: 264 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624966 UncompressedSize: 28941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 264 Data: "... 29125 bytes ..." SourceId: "\000src_id" SeqNo: 265 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624966 UncompressedSize: 29051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 265 Data: "... 29235 bytes ..." SourceId: "\000src_id" SeqNo: 266 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624966 UncompressedSize: 29161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 266 Data: "... 29345 bytes ..." SourceId: "\000src_id" SeqNo: 267 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624966 UncompressedSize: 29271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 267 Data: "... 29455 bytes ..." SourceId: "\000src_id" SeqNo: 268 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624967 UncompressedSize: 29381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 268 Data: "... 29565 bytes ..." SourceId: "\000src_id" SeqNo: 269 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624967 UncompressedSize: 29491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 269 Data: "... 29675 bytes ..." SourceId: "\000src_id" SeqNo: 270 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624967 UncompressedSize: 29601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 270 Data: "... 29785 bytes ..." SourceId: "\000src_id" SeqNo: 271 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624967 UncompressedSize: 29711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 271 Data: "... 29895 bytes ..." SourceId: "\000src_id" SeqNo: 272 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624967 UncompressedSize: 29821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 272 Data: "... 30005 bytes ..." SourceId: "\000src_id" SeqNo: 273 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 29931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 273 Data: "... 30115 bytes ..." SourceId: "\000src_id" SeqNo: 274 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 274 Data: "... 30225 bytes ..." SourceId: "\000src_id" SeqNo: 275 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 275 Data: "... 30335 bytes ..." SourceId: "\000src_id" SeqNo: 276 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 276 Data: "... 30445 bytes ..." SourceId: "\000src_id" SeqNo: 277 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 277 Data: "... 30555 bytes ..." SourceId: "\000src_id" SeqNo: 278 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 278 Data: "... 30665 bytes ..." SourceId: "\000src_id" SeqNo: 279 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 279 Data: "... 30775 bytes ..." SourceId: "\000src_id" SeqNo: 280 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 280 Data: "... 30885 bytes ..." SourceId: "\000src_id" SeqNo: 281 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 281 Data: "... 30995 bytes ..." SourceId: "\000src_id" SeqNo: 282 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 30921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 282 Data: "... 31105 bytes ..." SourceId: "\000src_id" SeqNo: 283 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 31031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 283 Data: "... 31215 bytes ..." SourceId: "\000src_id" SeqNo: 284 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624968 UncompressedSize: 31141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 284 Data: "... 31325 bytes ..." SourceId: "\000src_id" SeqNo: 285 WriteTimestampMS: 1759327625004 CreateTimestampMS: 1759327624969 UncompressedSize: 31251 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 663684 RealReadOffset: 284 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 263 }
2025-10-01T14:07:05.086463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 282
2025-10-01T14:07:05.083917Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 663124, now ReadSizeBudget = 0, ReadSizeServerDelta = -138836
2025-10-01T14:07:05.082433Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 285 endOffset 300
2025-10-01T14:07:05.013038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 287, partNo: 0, Offset: 286 is stored on disk
2025-10-01T14:07:05.082450Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 285 ReadGuid bf2d8bb5-abb94d46-a595dbdc-45f13647 has messages 1
2025-10-01T14:07:05.013039Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 288, partNo: 0, Offset: 287 is stored on disk
2025-10-01T14:07:05.013043Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013045Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 289, partNo: 0, Offset: 288 is stored on disk
2025-10-01T14:07:05.013046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 290, partNo: 0, Offset: 289 is stored on disk
2025-10-01T14:07:05.013050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013055Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 291, partNo: 0, Offset: 290 is stored on disk
2025-10-01T14:07:05.082523Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 285, endOffset# 300, WTime# 1759327625004, sizeLag# 663684
2025-10-01T14:07:05.013056Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.082527Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:07:05.013058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 292, partNo: 0, Offset: 291 is stored on disk
2025-10-01T14:07:05.013060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013062Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 293, partNo: 0, Offset: 292 is stored on disk
2025-10-01T14:07:05.082538Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# bf2d8bb5-abb94d46-a595dbdc-45f13647, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 663124
2025-10-01T14:07:05.013063Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.082548Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# bf2d8bb5-abb94d46-a595dbdc-45f13647
2025-10-01T14:07:05.013065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 294, partNo: 0, Offset: 293 is stored on disk
2025-10-01T14:07:05.083079Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 1
2025-10-01T14:07:05.013067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013069Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 295, partNo: 0, Offset: 294 is stored on disk
2025-10-01T14:07:05.013070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 296, partNo: 0, Offset: 295 is stored on disk
2025-10-01T14:07:05.013075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013078Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 297, partNo: 0, Offset: 296 is stored on disk
2025-10-01T14:07:05.086583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 283 offsets: 282 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.013079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.086587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 283
2025-10-01T14:07:05.013082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 298, partNo: 0, Offset: 297 is stored on disk
2025-10-01T14:07:05.013083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.013087Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 299, partNo: 0, Offset: 298 is stored on disk
2025-10-01T14:07:05.013088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:05.086600Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 21, size 547701 bytes
2025-10-01T14:07:05.086604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 284 offsets: 283 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.086629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 284
2025-10-01T14:07:05.013090Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 300, partNo: 0, Offset: 299 is stored on disk
2025-10-01T14:07:05.013112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.086640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 285 offsets: 284 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-01T14:07:05.086642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 285
2025-10-01T14:07:05.013114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.086658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 286 offsets: 285 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.086664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 286
2025-10-01T14:07:05.013115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.086673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 287 offsets: 286 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.013122Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:05.086676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 287
2025-10-01T14:07:05.013123Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000009_00000?
2025-10-01T14:07:05.013125Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000020_00000?
2025-10-01T14:07:05.013127Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000011_00000?
2025-10-01T14:07:05.086687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 288 offsets: 287 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.013128Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000012_00000?
2025-10-01T14:07:05.013129Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000053_00000_0000000020_00000?
2025-10-01T14:07:05.086690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 288
2025-10-01T14:07:05.013130Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000073_00000_0000000050_00000?
2025-10-01T14:07:05.013131Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000123_00000_0000000080_00000?
2025-10-01T14:07:05.013133Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000203_00000_0000000020_00000?
2025-10-01T14:07:05.013134Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000223_00000_0000000020_00000?
2025-10-01T14:07:05.013135Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000243_00000_0000000020_00000?
2025-10-01T14:07:05.013138Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000263_00000_0000000022_00000?
2025-10-01T14:07:05.086718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 289 offsets: 288 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.013139Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000285_00000_0000000015_00000?
2025-10-01T14:07:05.013141Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 13 keys were taken away. Let's read 4963494 bytes (4963494)
2025-10-01T14:07:05.086720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 289
2025-10-01T14:07:05.013143Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 13, size 4963494 (8388608)
2025-10-01T14:07:05.013152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 575  requestId: <none> cookie: 286
2025-10-01T14:07:05.013170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 576  requestId: <none> cookie: 287
2025-10-01T14:07:05.086740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 290 offsets: 289 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-10-01T14:07:05.086742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 290
2025-10-01T14:07:05.013174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 577  requestId: <none> cookie: 288
2025-10-01T14:07:05.013177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 578  requestId: <none> cookie: 289
2025-10-01T14:07:05.086751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 291 offsets: 290 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.013180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 579  requestId: <none> cookie: 290
2025-10-01T14:07:05.086754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 291
2025-10-01T14:07:05.013184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 585  requestId: <none> cookie: 291
2025-10-01T14:07:05.013189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 586  requestId: <none> cookie: 292
2025-10-01T14:07:05.013192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 587  requestId: <none> cookie: 293
2025-10-01T14:07:05.086765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 292 offsets: 291 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.013196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 588  requestId: <none> cookie: 294
2025-10-01T14:07:05.013199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 589  requestId: <none> cookie: 295
2025-10-01T14:07:05.086767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 292
2025-10-01T14:07:05.013202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 595  requestId: <none> cookie: 296
2025-10-01T14:07:05.013206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 596  requestId: <none> cookie: 297
2025-10-01T14:07:05.013209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 597  requestId: <none> cookie: 298
2025-10-01T14:07:05.086786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 293 offsets: 292 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.086788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 293
2025-10-01T14:07:05.013212Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 598  requestId: <none> cookie: 299
2025-10-01T14:07:05.086800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 294 offsets: 293 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.086803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 294
2025-10-01T14:07:05.013215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 599  requestId: <none> cookie: 300
2025-10-01T14:07:05.058853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.058859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.086815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 295 offsets: 294 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.058862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.060809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.086828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 295
2025-10-01T14:07:05.060820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.060880Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 203 count 24 size 524288 endOffset 300 max time lag 0ms effective offset 203
2025-10-01T14:07:05.060918Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 2 blobs, size 983032 count 40 last offset 223, current partition end offset: 300
2025-10-01T14:07:05.086856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 296 offsets: 295 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.060922Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-01T14:07:05.086859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 296
2025-10-01T14:07:05.060936Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 203 partno 0 count 20 parts_count 0 source 1 size 469516 accessed 0 times before, last time 2025-10-01T14:07:04.000000Z
2025-10-01T14:07:05.060955Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 223 partno 0 count 20 parts_count 0 source 1 size 513516 accessed 0 times before, last time 2025-10-01T14:07:05.000000Z
2025-10-01T14:07:05.060966Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 2 blobs are from cache.
2025-10-01T14:07:05.060981Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-01T14:07:05.086873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 297 offsets: 296 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.061283Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 203 totakecount 20 count 20 size 469493 from pos 0 cbcount 20
2025-10-01T14:07:05.086875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 297
2025-10-01T14:07:05.061625Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 223 totakecount 20 count 20 size 513493 from pos 0 cbcount 20
2025-10-01T14:07:05.061688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 203
2025-10-01T14:07:05.086886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 298 offsets: 297 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.086889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 298
2025-10-01T14:07:05.061779Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 203 partno 0 count 20 parts 0 suffix '63'
2025-10-01T14:07:05.061785Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 223 partno 0 count 20 parts 0 suffix '63'
2025-10-01T14:07:05.086905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 299 offsets: 298 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.075697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.086908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 299
2025-10-01T14:07:05.075712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.075766Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 227 count 87 size 524288 endOffset 300 max time lag 0ms effective offset 227
2025-10-01T14:07:05.075802Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 2 blobs, size 557570 count 36 last offset 243, current partition end offset: 300
2025-10-01T14:07:05.075807Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-01T14:07:05.075820Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 223 partno 0 count 20 parts_count 0 source 1 size 513516 accessed 1 times before, last time 2025-10-01T14:07:05.000000Z
2025-10-01T14:07:05.086928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session got write response: sequence_numbers: 300 offsets: 299 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-10-01T14:07:05.075824Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 243 partno 0 count 20 parts_count 0 source 1 size 557570 accessed 0 times before, last time 2025-10-01T14:07:05.000000Z
2025-10-01T14:07:05.086930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: acknoledged message 300
2025-10-01T14:07:05.075841Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 2 blobs are from cache.
2025-10-01T14:07:05.075856Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-01T14:07:05.076269Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 223 totakecount 20 count 20 size 513493 from pos 4 cbcount 20
2025-10-01T14:07:05.076561Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 243 totakecount 20 count 19 size 528577 from pos 0 cbcount 19
2025-10-01T14:07:05.076602Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 262 totakecount 20 count 1 size 28947 from pos 0 cbcount 1
2025-10-01T14:07:05.076690Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 227
2025-10-01T14:07:05.076795Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 223 partno 0 count 20 parts 0 suffix '63'
2025-10-01T14:07:05.076801Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 243 partno 0 count 20 parts 0 suffix '63'
2025-10-01T14:07:05.080647Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.080657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.080698Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 263 count 44 size 524288 endOffset 300 max time lag 0ms effective offset 263
2025-10-01T14:07:05.080715Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 664174 count 22 last offset 263, current partition end offset: 300
2025-10-01T14:07:05.080718Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-01T14:07:05.080727Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 263 partno 0 count 22 parts_count 0 source 1 size 664174 accessed 0 times before, last time 2025-10-01T14:07:05.000000Z
2025-10-01T14:07:05.080737Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-01T14:07:05.080747Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:05.080792Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 263 partno 0 count 22 parts 0 suffix '63'
2025-10-01T14:07:05.081083Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 263 totakecount 22 count 18 size 539371 from pos 0 cbcount 18
2025-10-01T14:07:05.081176Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 281 totakecount 22 count 4 size 124757 from pos 0 cbcount 4
2025-10-01T14:07:05.081227Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 263
2025-10-01T14:07:05.086689Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (248-262)
2025-10-01T14:07:05.090421Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.090453Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (248-248)
2025-10-01T14:07:05.090489Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 6} (249-249)
2025-10-01T14:07:05.090512Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 7} (250-250)
2025-10-01T14:07:05.090521Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 8} (251-251)
2025-10-01T14:07:05.090549Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 9} (252-252)
2025-10-01T14:07:05.090558Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 10} (253-253)
2025-10-01T14:07:05.090567Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 11} (254-254)
2025-10-01T14:07:05.090576Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 12} (255-255)
2025-10-01T14:07:05.090622Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 13} (256-256)
2025-10-01T14:07:05.090630Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 14} (257-257)
2025-10-01T14:07:05.090638Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 15} (258-258)
2025-10-01T14:07:05.090646Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 16} (259-259)
2025-10-01T14:07:05.090657Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 17} (260-260)
2025-10-01T14:07:05.090669Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 18} (261-261)
2025-10-01T14:07:05.090677Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (262-262)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..27291 bytes.. Information: { Offset: 248 ProducerId: "src_id" SeqNo: 249 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27401 bytes.. Information: { Offset: 249 ProducerId: "src_id" SeqNo: 250 CreateTime: 2025-10-01T14:07:04.965000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27511 bytes.. Information: { Offset: 250 ProducerId: "src_id" SeqNo: 251 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27621 bytes.. Information: { Offset: 251 ProducerId: "src_id" SeqNo: 252 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27731 bytes.. Information: { Offset: 252 ProducerId: "src_id" SeqNo: 253 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27841 bytes.. Information: { Offset: 253 ProducerId: "src_id" SeqNo: 254 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27951 bytes.. Information: { Offset: 254 ProducerId: "src_id" SeqNo: 255 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28061 bytes.. Information: { Offset: 255 ProducerId: "src_id" SeqNo: 256 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28171 bytes.. Information: { Offset: 256 ProducerId: "src_id" SeqNo: 257 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28281 bytes.. Information: { Offset: 257 ProducerId: "src_id" SeqNo: 258 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28391 bytes.. Information: { Offset: 258 ProducerId: "src_id" SeqNo: 259 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28501 bytes.. Information: { Offset: 259 ProducerId: "src_id" SeqNo: 260 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28611 bytes.. Information: { Offset: 260 ProducerId: "src_id" SeqNo: 261 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28721 bytes.. Information: { Offset: 261 ProducerId: "src_id" SeqNo: 262 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.000000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40954", "logtype": "unknown", "server": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28831 bytes.. Information: { Offset: 262 ProducerId: "src_id" SeqNo: 263 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.001000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40954", "server": "ipv6:[::1]:40954", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.091008Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 15, size 420915 bytes
2025-10-01T14:07:05.091027Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.091168Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (263-280)
2025-10-01T14:07:05.091173Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 663124 to budget
2025-10-01T14:07:05.091181Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 663124, ReadSizeServerDelta = -138836
2025-10-01T14:07:05.091305Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:05.091323Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (263-263)
2025-10-01T14:07:05.091339Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (264-264)
2025-10-01T14:07:05.091358Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (265-265)
2025-10-01T14:07:05.091368Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (266-266)
2025-10-01T14:07:05.091392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (267-267)
2025-10-01T14:07:05.091400Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (268-268)
2025-10-01T14:07:05.091408Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (269-269)
2025-10-01T14:07:05.091418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (270-270)
2025-10-01T14:07:05.091472Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (271-271)
2025-10-01T14:07:05.091482Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (272-272)
2025-10-01T14:07:05.091490Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (273-273)
2025-10-01T14:07:05.091497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (274-274)
2025-10-01T14:07:05.091505Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (275-275)
2025-10-01T14:07:05.091512Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (276-276)
2025-10-01T14:07:05.091519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (277-277)
2025-10-01T14:07:05.091529Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (278-278)
2025-10-01T14:07:05.091497Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 663124 } }
2025-10-01T14:07:05.091593Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# 59628110-6e99d7bf-b2716803-9eb729a
2025-10-01T14:07:05.091626Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (279-279)
2025-10-01T14:07:05.091626Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 performing read request: guid# 6e528a34-cba9f967-b96aa083-613fd015, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:07:05.091637Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (280-280)
2025-10-01T14:07:05.091653Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 285 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid 6e528a34-cba9f967-b96aa083-613fd015
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..28941 bytes.. Information: { Offset: 263 ProducerId: "src_id" SeqNo: 264 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29051 bytes.. Information: { Offset: 264 ProducerId: "src_id" SeqNo: 265 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29161 bytes.. Information: { Offset: 265 ProducerId: "src_id" SeqNo: 266 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29271 bytes.. Information: { Offset: 266 ProducerId: "src_id" SeqNo: 267 CreateTime: 2025-10-01T14:07:04.966000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29381 bytes.. Information: { Offset: 267 ProducerId: "src_id" SeqNo: 268 CreateTime: 2025-10-01T14:07:04.967000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29491 bytes.. Information: { Offset: 268 ProducerId: "src_id" SeqNo: 269 CreateTime: 2025-10-01T14:07:04.967000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29601 bytes.. Information: { Offset: 269 ProducerId: "src_id" SeqNo: 270 CreateTime: 2025-10-01T14:07:04.967000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29711 bytes.. Information: { Offset: 270 ProducerId: "src_id" SeqNo: 271 CreateTime: 2025-10-01T14:07:04.967000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29821 bytes.. Information: { Offset: 271 ProducerId: "src_id" SeqNo: 272 CreateTime: 2025-10-01T14:07:04.967000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29931 bytes.. Information: { Offset: 272 ProducerId: "src_id" SeqNo: 273 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30041 bytes.. Information: { Offset: 273 ProducerId: "src_id" SeqNo: 274 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30151 bytes.. Information: { Offset: 274 ProducerId: "src_id" SeqNo: 275 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30261 bytes.. Information: { Offset: 275 ProducerId: "src_id" SeqNo: 276 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30371 bytes.. Information: { Offset: 276 ProducerId: "src_id" SeqNo: 277 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30481 bytes.. Information: { Offset: 277 ProducerId: "src_id" SeqNo: 278 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30591 bytes.. Information: { Offset: 278 ProducerId: "src_id" SeqNo: 279 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30701 bytes.. Information: { Offset: 279 ProducerId: "src_id" SeqNo: 280 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30811 bytes.. Information: { Offset: 280 ProducerId: "src_id" SeqNo: 281 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.091827Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.091849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.091906Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 285 count 18 size 524288 endOffset 300 max time lag 0ms effective offset 285
2025-10-01T14:07:05.091931Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 483336 count 15 last offset 285, current partition end offset: 300
2025-10-01T14:07:05.091937Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-01T14:07:05.091949Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 285 partno 0 count 15 parts_count 0 source 1 size 483336 accessed 0 times before, last time 2025-10-01T14:07:05.000000Z
2025-10-01T14:07:05.091960Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 1 blobs are from cache.
2025-10-01T14:07:05.091974Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:05.092294Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 285 totakecount 15 count 15 size 483313 from pos 0 cbcount 15
2025-10-01T14:07:05.092361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 285
2025-10-01T14:07:05.092465Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 285 partno 0 count 15 parts 0 suffix '63'
2025-10-01T14:07:05.093196Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 285 Data: "... 31435 bytes ..." SourceId: "\000src_id" SeqNo: 286 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 31361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 286 Data: "... 31545 bytes ..." SourceId: "\000src_id" SeqNo: 287 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 31471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 287 Data: "... 31655 bytes ..." SourceId: "\000src_id" SeqNo: 288 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 31581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 288 Data: "... 31765 bytes ..." SourceId: "\000src_id" SeqNo: 289 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 31691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 289 Data: "... 31875 bytes ..." SourceId: "\000src_id" SeqNo: 290 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 31801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 290 Data: "... 31985 bytes ..." SourceId: "\000src_id" SeqNo: 291 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 31911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 291 Data: "... 32095 bytes ..." SourceId: "\000src_id" SeqNo: 292 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 292 Data: "... 32205 bytes ..." SourceId: "\000src_id" SeqNo: 293 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 293 Data: "... 32315 bytes ..." SourceId: "\000src_id" SeqNo: 294 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 294 Data: "... 32425 bytes ..." SourceId: "\000src_id" SeqNo: 295 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 295 Data: "... 32535 bytes ..." SourceId: "\000src_id" SeqNo: 296 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 296 Data: "... 32645 bytes ..." SourceId: "\000src_id" SeqNo: 297 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 297 Data: "... 32755 bytes ..." SourceId: "\000src_id" SeqNo: 298 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 298 Data: "... 32865 bytes ..." SourceId: "\000src_id" SeqNo: 299 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 299 Data: "... 32975 bytes ..." SourceId: "\000src_id" SeqNo: 300 WriteTimestampMS: 1759327625009 CreateTimestampMS: 1759327624969 UncompressedSize: 32901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551247 RealReadOffset: 299 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 285 }
2025-10-01T14:07:05.093350Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 300
2025-10-01T14:07:05.093359Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 300 ReadGuid 6e528a34-cba9f967-b96aa083-613fd015 has messages 1
2025-10-01T14:07:05.093417Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 read done: guid# 6e528a34-cba9f967-b96aa083-613fd015, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 482697
2025-10-01T14:07:05.098622Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 18, size 537768 bytes
2025-10-01T14:07:05.093430Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 response to read: guid# 6e528a34-cba9f967-b96aa083-613fd015
2025-10-01T14:07:05.093809Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 Process answer. Aval parts: 0
2025-10-01T14:07:05.098722Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (281-284)
2025-10-01T14:07:05.098729Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.098752Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (281-281)
2025-10-01T14:07:05.098768Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (282-282)
2025-10-01T14:07:05.098791Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (283-283)
2025-10-01T14:07:05.098800Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (284-284)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..30921 bytes.. Information: { Offset: 281 ProducerId: "src_id" SeqNo: 282 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31031 bytes.. Information: { Offset: 282 ProducerId: "src_id" SeqNo: 283 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31141 bytes.. Information: { Offset: 283 ProducerId: "src_id" SeqNo: 284 CreateTime: 2025-10-01T14:07:04.968000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31251 bytes.. Information: { Offset: 284 ProducerId: "src_id" SeqNo: 285 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.004000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "_ip": "ipv6:[::1]:40954", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.098929Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 4, size 124344 bytes
2025-10-01T14:07:05.098940Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.098975Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Got ReadResponse, serverBytesSize = 482697, now ReadSizeBudget = 0, ReadSizeServerDelta = 41591
2025-10-01T14:07:05.099047Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 41591
2025-10-01T14:07:05.102419Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (285-299)
2025-10-01T14:07:05.102441Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 482697 to budget
2025-10-01T14:07:05.102449Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] In ContinueReadingDataImpl, ReadSizeBudget = 482697, ReadSizeServerDelta = 41591
2025-10-01T14:07:05.102592Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:07:05.102620Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (285-285)
2025-10-01T14:07:05.102642Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (286-286)
2025-10-01T14:07:05.102666Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (287-287)
2025-10-01T14:07:05.102676Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (288-288)
2025-10-01T14:07:05.102710Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (289-289)
2025-10-01T14:07:05.102719Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (290-290)
2025-10-01T14:07:05.102729Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (291-291)
2025-10-01T14:07:05.102739Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (292-292)
2025-10-01T14:07:05.102792Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (293-293)
2025-10-01T14:07:05.102801Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (294-294)
2025-10-01T14:07:05.102811Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (295-295)
2025-10-01T14:07:05.102820Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (296-296)
2025-10-01T14:07:05.102830Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (297-297)
2025-10-01T14:07:05.102872Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (298-298)
2025-10-01T14:07:05.102916Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (299-299)
2025-10-01T14:07:05.102893Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 1, data# { read_request { bytes_size: 482697 } }
2025-10-01T14:07:05.102989Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 got read request: guid# fc8a74f8-b12fcaae-6636312c-280b4d37
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..31361 bytes.. Information: { Offset: 285 ProducerId: "src_id" SeqNo: 286 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31471 bytes.. Information: { Offset: 286 ProducerId: "src_id" SeqNo: 287 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31581 bytes.. Information: { Offset: 287 ProducerId: "src_id" SeqNo: 288 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31691 bytes.. Information: { Offset: 288 ProducerId: "src_id" SeqNo: 289 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31801 bytes.. Information: { Offset: 289 ProducerId: "src_id" SeqNo: 290 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31911 bytes.. Information: { Offset: 290 ProducerId: "src_id" SeqNo: 291 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32021 bytes.. Information: { Offset: 291 ProducerId: "src_id" SeqNo: 292 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32131 bytes.. Information: { Offset: 292 ProducerId: "src_id" SeqNo: 293 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32241 bytes.. Information: { Offset: 293 ProducerId: "src_id" SeqNo: 294 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32351 bytes.. Information: { Offset: 294 ProducerId: "src_id" SeqNo: 295 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32461 bytes.. Information: { Offset: 295 ProducerId: "src_id" SeqNo: 296 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32571 bytes.. Information: { Offset: 296 ProducerId: "src_id" SeqNo: 297 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32681 bytes.. Information: { Offset: 297 ProducerId: "src_id" SeqNo: 298 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32791 bytes.. Information: { Offset: 298 ProducerId: "src_id" SeqNo: 299 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32901 bytes.. Information: { Offset: 299 ProducerId: "src_id" SeqNo: 300 CreateTime: 2025-10-01T14:07:04.969000Z WriteTime: 2025-10-01T14:07:05.009000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40954", "logtype": "unknown", "_ip": "ipv6:[::1]:40954" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:07:05.103381Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] The application data is transferred to the client. Number of messages 15, size 481965 bytes
2025-10-01T14:07:05.103391Z :DEBUG: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:07:05.103419Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Closing read session. Close timeout: 18446744073709.551615s
2025-10-01T14:07:05.103445Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-01T14:07:05.103454Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 396 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.103693Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Closing read session. Close timeout: 18446744073709.551615s
2025-10-01T14:07:05.103703Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:05.103707Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Counters: { Errors: 0 CurrentSessionLifetimeMs: 395 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.103894Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Closing read session. Close timeout: 18446744073709.551615s
2025-10-01T14:07:05.103904Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:05.103876Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:07:05.103908Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 396 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.103889Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc read failed
2025-10-01T14:07:05.103895Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 grpc closed
2025-10-01T14:07:05.103917Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_16680753683149146617_v1 is DEAD
2025-10-01T14:07:05.104064Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:07:05.104077Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 grpc read failed
2025-10-01T14:07:05.104082Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 grpc closed
2025-10-01T14:07:05.104087Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_13839204300470945875_v1 is DEAD
2025-10-01T14:07:05.104432Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_2_16680753683149146617_v1
2025-10-01T14:07:05.104456Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254612244916574:2516] destroyed
2025-10-01T14:07:05.104475Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_2_16680753683149146617_v1
2025-10-01T14:07:05.104214Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:07:05.104224Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 grpc read failed
2025-10-01T14:07:05.104227Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 grpc closed
2025-10-01T14:07:05.104231Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_12422149058125272650_v1 is DEAD
2025-10-01T14:07:05.104309Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916566:2506] disconnected; active server actors: 1
2025-10-01T14:07:05.104313Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916566:2506] client user disconnected session shared/user_3_2_16680753683149146617_v1
2025-10-01T14:07:05.104332Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:05.104344Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:05.104358Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_12422149058125272650_v1" (Sender=[3:7556254612244916555:2505], Pipe=[3:7556254612244916568:2505], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:05.104367Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_12422149058125272650_v1" sender [3:7556254612244916555:2505] lock partition 0 for ReadingSession "shared/user_3_1_12422149058125272650_v1" (Sender=[3:7556254612244916555:2505], Pipe=[3:7556254612244916568:2505], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-01T14:07:05.104376Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-01T14:07:05.104381Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:07:05.104384Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916569:2507] disconnected; active server actors: 1
2025-10-01T14:07:05.104387Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916569:2507] client user disconnected session shared/user_3_3_13839204300470945875_v1
2025-10-01T14:07:05.104389Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:05.104392Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916568:2505] disconnected; active server actors: 1
2025-10-01T14:07:05.104394Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254612244916568:2505] client user disconnected session shared/user_3_1_12422149058125272650_v1
2025-10-01T14:07:05.107369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: close. Timeout = 0 ms
2025-10-01T14:07:05.107383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session will now close
2025-10-01T14:07:05.107388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: aborting
2025-10-01T14:07:05.107580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:07:05.107587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0] Write session: destroy
2025-10-01T14:07:05.108116Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:05.108131Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-01T14:07:05.108142Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 401 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.108173Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:05.108178Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:05.108182Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Counters: { Errors: 0 CurrentSessionLifetimeMs: 400 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.108187Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:05.108192Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:05.108195Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 400 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.108201Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:05.108202Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:05.108204Z :INFO: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 400 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.108217Z :NOTICE: [/Root] [/Root] [76c0c524-cdb66bba-8fd24720-5ca9359c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:07:05.107779Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read done: success: 0 data: 
2025-10-01T14:07:05.107793Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc read failed
2025-10-01T14:07:05.107802Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 grpc closed
2025-10-01T14:07:05.107808Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|5cf9fb9f-ffd59ba5-57daf33d-f33b718a_0 is DEAD
2025-10-01T14:07:05.108071Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:07:05.108603Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:05.108617Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:07:05.108622Z :INFO: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Counters: { Errors: 0 CurrentSessionLifetimeMs: 400 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.108629Z :NOTICE: [/Root] [/Root] [f6a5e350-970a0673-70b07d65-532c0202] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:07:05.108690Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Closing read session. Close timeout: 0.000000s
2025-10-01T14:07:05.108698Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-01T14:07:05.108703Z :INFO: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 401 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:05.108707Z :NOTICE: [/Root] [/Root] [d25a7be3-a4a438bb-1e1ed3ca-cb1875e8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:07:05.109749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254612244916613:2517] destroyed
2025-10-01T14:07:05.109776Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:07:05.109786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.109790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.109792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.159221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.159240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.159244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.259519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.259542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.259545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.319659Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720689, task: 1, CA Id [3:7556254616539883947:2522]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-01T14:07:05.352452Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720689, task: 1, CA Id [3:7556254616539883947:2522]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-01T14:07:05.469163Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976720689, task: 1, CA Id [3:7556254616539883947:2522]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-01T14:06:14.743086Z :WriteSessionCloseWaitsForWrites INFO: Random seed for debugging is 1759327574743080
2025-10-01T14:06:14.837090Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254397116859801:2079];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:14.837527Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/tmpTv3W1T/pdisk_1.dat
2025-10-01T14:06:14.845527Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:14.845516Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:14.891227Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.891294Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-01T14:06:14.892542Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.902508Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 11409, node 1
2025-10-01T14:06:14.940165Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.940196Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:14.946612Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/yandex39hdKW.tmp
2025-10-01T14:06:14.946625Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/yandex39hdKW.tmp
2025-10-01T14:06:14.946692Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/yandex39hdKW.tmp
2025-10-01T14:06:14.946745Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:14.947370Z INFO: TTestServer started on Port 21965 GrpcPort 11409
2025-10-01T14:06:14.946935Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:14.947593Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.947613Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:14.948974Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:14.949297Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:21965
PQClient connected to localhost:11409
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:14.969569Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:15.070213Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.094980Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.260220Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401411828026:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.260260Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.260426Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401411828062:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.260445Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401411828063:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.260459Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.261344Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:15.268383Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254401408198931:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.268406Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254401408198906:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.268417Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.270430Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401411828098:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.270456Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.274424Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401411828105:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.274566Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.274528Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254401408198936:2130] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.282747Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556254401408198935:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:15.282712Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254401411828066:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:15.326441Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.358991Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.371739Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254401408199037:2177] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.374299Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254401411828330:2799] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.389403Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254401408199043:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.389506Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NTJmMjRjZjYtYjIzYjA1NDgtYmJiMmExNTctYmVhMDBhODk=, ActorId: [2:7556254401408198903:2294], ActorState: ExecuteState, TraceId: 01k6g1gq731zh9psckzq0fmx3q, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.390022Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.389525Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254401411828352:2348], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.389659Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ZjI4YWVmMDItNjQyNDZkNzctZjRlYzgxN2YtOTNhOTNmMzY=, ActorId: [1:7556254401411828021:2320], ActorState: ExecuteState, TraceId: 01k6g1gq6sfdqk3bs59m1gkcmx, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.390146Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.393786Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11409", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:15.433687Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gqbncdxmfzwkqhrgrd65, Database: , SessionId: ydb://session/3?node_id=1&id=Y2FjYzYzOGQtYjUyYzg1YjMtZjgwMGNhNWEtOWVlZjk2YWE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254401411828548:2943] 
2025-10-01T14:06:15.840077Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:15.845219Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:19.837293Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254397116859801:2079];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:19.837330Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:20.621175Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11409
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.642092Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11409
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.648562Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254422886665546:3252] connected; active server actors: 1
2025-10-01T14:06:20.648612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.648741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.648959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.651263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.651816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.651876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.651888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.651900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.651975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254422886665570:2454], now have 1 active actors on pipe
2025-10-01T14:06:20.651984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254422886665544:3251], now have 1 active actors on pipe
2025-10-01T14:06:20.652039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:20.652159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.653154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.655072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254422886665605:3299], now have 1 active actors on pipe
2025-10-01T14:06:20.655282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.656247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.656421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.656442Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.656491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.656566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254422883036022:2401]
2025-10-01T14:06:20.657173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.657184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.657188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254422883036022:2401]
2025-10-01T14:06:20.657194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.657456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.657468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.657490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.657496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.657500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.657502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.657503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.657504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.657510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.657625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.657656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.658642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.658680Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580703, TxId 281474976720679
2025-10-01T14:06:20.658684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.658686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.658706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.658744Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.659379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.659440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.659451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.659454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.659456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.659461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.659547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.659570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.659608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.660863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.660884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.661508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.662062Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1gwf75zht9f6kex3xvfcv, Database: , SessionId: ydb://session/3?node_id=1&id=NWIzZjg0MTUtNDdlYzY1YmYtZDk1OTc2NzYtZTYyZTg0ZTU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327580703
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327580703
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11409
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.668121Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.757816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.757829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.757832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.858187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.858200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.858201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.958556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.958572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.958575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.058900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.058919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.058922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.161193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.161212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.161214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11409
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.170012Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.261135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.261149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.261151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.361979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.361997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.362001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.462393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.462408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.462415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.562810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.562824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.562827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.663028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.663042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.663044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11409
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.675461Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.679649Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.679864Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.679871Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11409
2025-10-01T14:06:21.681959Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.682723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.682743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.686350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.686420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58014
2025-10-01T14:06:21.686442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58014 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.686453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.686897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.686933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.686935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.686937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.686941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.687437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.714573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.714646Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427181633109:2488] connected; active server actors: 1
2025-10-01T14:06:21.714666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:21.714670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.714731Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427181633109:2488] disconnected; active server actors: 1
2025-10-01T14:06:21.714737Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427181633109:2488] disconnected no session
2025-10-01T14:06:21.731777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:21.731794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:21.731798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254427181633078:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:21.731807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:21.732120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254427181633132:2488], now have 1 active actors on pipe
2025-10-01T14:06:21.732170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:21.732637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|72206364-f2da9764-c9396d6b-2256516c_0
2025-10-01T14:06:21.732992Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327581732 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.733037Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|72206364-f2da9764-c9396d6b-2256516c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:21.733185Z :INFO: [] MessageGroupId [src] SessionId [src|72206364-f2da9764-c9396d6b-2256516c_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:21.733211Z :INFO: [] MessageGroupId [src] SessionId [src|72206364-f2da9764-c9396d6b-2256516c_0] Write session will now close
2025-10-01T14:06:21.733217Z :DEBUG: [] MessageGroupId [src] SessionId [src|72206364-f2da9764-c9396d6b-2256516c_0] Write session: aborting
2025-10-01T14:06:21.733337Z :INFO: [] MessageGroupId [src] SessionId [src|72206364-f2da9764-c9396d6b-2256516c_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:21.733342Z :DEBUG: [] MessageGroupId [src] SessionId [src|72206364-f2da9764-c9396d6b-2256516c_0] Write session: destroy
2025-10-01T14:06:21.733546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|72206364-f2da9764-c9396d6b-2256516c_0 grpc read done: success: 0 data: 
2025-10-01T14:06:21.733555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|72206364-f2da9764-c9396d6b-2256516c_0 grpc read failed
2025-10-01T14:06:21.733561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|72206364-f2da9764-c9396d6b-2256516c_0 grpc closed
2025-10-01T14:06:21.733566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|72206364-f2da9764-c9396d6b-2256516c_0 is DEAD
2025-10-01T14:06:21.733832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:21.732237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.732252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.732278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|72206364-f2da9764-c9396d6b-2256516c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:21.732288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.732293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.732296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.732307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.732322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:21.732347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.732530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.732533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.732544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.733940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254427181633132:2488] destroyed
2025-10-01T14:06:21.733950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:21.733955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.733957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.733959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:06:21.766437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.766455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.766458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:06:21.802909Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:11409" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:11409" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:11409" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-01T14:06:21.812904Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:21.813081Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:06:21.870439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.870457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.870460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.888518Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-01T14:06:21.891167Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:21.891331Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-01T14:06:21.891721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.891738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-01T14:06:21.891974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:21.892011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:43492
2025-10-01T14:06:21.892017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:43492 proto=topic  topic=test-topic durationSec=0
2025-10-01T14:06:21.892022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.895266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-01T14:06:21.895305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.895307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.895309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.895314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.895886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.922166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.922579Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427181633168:2504] connected; active server actors: 1
2025-10-01T14:06:21.922669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-01T14:06:21.922676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.923045Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427181633168:2504] disconnected; active server actors: 1
2025-10-01T14:06:21.923051Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427181633168:2504] disconnected no session
2025-10-01T14:06:21.942975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:21.942990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:21.942994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254427181633148:2504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:21.943002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:21.944160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254427181633187:2504], now have 1 active actors on pipe
2025-10-01T14:06:21.944292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:21.944441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.944454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.944484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:21.944496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.944502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.944505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.944519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.944536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:21.944559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.944879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.944887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.944906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.945594Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:21.945612Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327581945 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.945655Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-01T14:06:21.945743Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-01T14:06:21.945774Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
2025-10-01T14:06:21.945787Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
2025-10-01T14:06:21.945794Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 4 to 4
2025-10-01T14:06:21.945802Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 5 to 5
2025-10-01T14:06:21.945808Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 6 to 6
2025-10-01T14:06:21.945814Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 7 to 7
2025-10-01T14:06:21.945820Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 8 to 8
2025-10-01T14:06:21.945828Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 9 to 9
2025-10-01T14:06:21.945835Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 10 to 10
2025-10-01T14:06:21.945842Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 11 to 11
2025-10-01T14:06:21.945849Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 12 to 12
2025-10-01T14:06:21.945859Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 13 to 13
2025-10-01T14:06:21.945865Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 14 to 14
2025-10-01T14:06:21.945871Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 15 to 15
2025-10-01T14:06:21.945877Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 16 to 16
2025-10-01T14:06:21.945883Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 17 to 17
2025-10-01T14:06:21.945892Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 18 to 18
2025-10-01T14:06:21.945898Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 19 to 19
2025-10-01T14:06:21.945904Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 20 to 20
2025-10-01T14:06:21.945909Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 21 to 21
2025-10-01T14:06:21.945914Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 22 to 22
2025-10-01T14:06:21.945920Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 23 to 23
2025-10-01T14:06:21.945937Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 24 to 24
2025-10-01T14:06:21.945946Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 25 to 25
2025-10-01T14:06:21.945952Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 26 to 26
2025-10-01T14:06:21.945957Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 27 to 27
2025-10-01T14:06:21.945964Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 28 to 28
2025-10-01T14:06:21.945969Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 29 to 29
2025-10-01T14:06:21.945976Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 30 to 30
2025-10-01T14:06:21.945982Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 31 to 31
2025-10-01T14:06:21.945987Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 32 to 32
2025-10-01T14:06:21.945993Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 33 to 33
2025-10-01T14:06:21.946001Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 34 to 34
2025-10-01T14:06:21.946008Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 35 to 35
2025-10-01T14:06:21.946016Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 36 to 36
2025-10-01T14:06:21.946023Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 37 to 37
2025-10-01T14:06:21.946031Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 38 to 38
2025-10-01T14:06:21.946038Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 39 to 39
2025-10-01T14:06:21.946045Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 40 to 40
2025-10-01T14:06:21.946059Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 41 to 41
2025-10-01T14:06:21.946066Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 42 to 42
2025-10-01T14:06:21.946074Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 43 to 43
2025-10-01T14:06:21.946080Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 44 to 44
2025-10-01T14:06:21.946087Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 45 to 45
2025-10-01T14:06:21.946095Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 46 to 46
2025-10-01T14:06:21.946104Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 47 to 47
2025-10-01T14:06:21.946111Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 48 to 48
2025-10-01T14:06:21.946120Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 49 to 49
2025-10-01T14:06:21.946127Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 50 to 50
2025-10-01T14:06:21.946134Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 51 to 51
2025-10-01T14:06:21.946142Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 52 to 52
2025-10-01T14:06:21.946151Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 53 to 53
2025-10-01T14:06:21.946157Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 54 to 54
2025-10-01T14:06:21.946164Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 55 to 55
2025-10-01T14:06:21.946173Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 56 to 56
2025-10-01T14:06:21.946181Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 57 to 57
2025-10-01T14:06:21.946187Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 58 to 58
2025-10-01T14:06:21.946195Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 59 to 59
2025-10-01T14:06:21.946201Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 60 to 60
2025-10-01T14:06:21.946210Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 61 to 61
2025-10-01T14:06:21.946216Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 62 to 62
2025-10-01T14:06:21.946224Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 63 to 63
2025-10-01T14:06:21.946238Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 64 to 64
2025-10-01T14:06:21.946249Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 65 to 65
2025-10-01T14:06:21.946257Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 66 to 66
2025-10-01T14:06:21.946263Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 67 to 67
2025-10-01T14:06:21.946271Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 68 to 68
2025-10-01T14:06:21.946277Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 69 to 69
2025-10-01T14:06:21.946287Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 70 to 70
2025-10-01T14:06:21.946353Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:21.946388Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Send 22 message(s) (48 left), first sequence number is 1
2025-10-01T14:06:21.945062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0
2025-10-01T14:06:21.947289Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:21.947299Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Send 48 message(s) (0 left), first sequence number is 23
2025-10-01T14:06:21.947796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:21.947943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:21.948237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.948251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.948280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:21.948415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:21.948426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:21.948660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:21.948938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.948948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.949060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:21.949104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-01T14:06:21.949165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.949167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.949175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:21.949210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.949224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.949227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (22)
2025-10-01T14:06:21.949258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:06:21.949341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-01T14:06:21.949351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-01T14:06:21.949357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 312 count 2 nextOffset 2 batches 1
2025-10-01T14:06:21.949361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-01T14:06:21.949366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 452 count 3 nextOffset 3 batches 1
2025-10-01T14:06:21.949370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-01T14:06:21.949374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 592 count 4 nextOffset 4 batches 1
2025-10-01T14:06:21.949378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-01T14:06:21.949383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 732 count 5 nextOffset 5 batches 1
2025-10-01T14:06:21.949386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-01T14:06:21.949391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 872 count 6 nextOffset 6 batches 1
2025-10-01T14:06:21.949394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-01T14:06:21.949399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1012 count 7 nextOffset 7 batches 1
2025-10-01T14:06:21.949402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-01T14:06:21.949406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1152 count 8 nextOffset 8 batches 1
2025-10-01T14:06:21.949409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-01T14:06:21.949416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1292 count 9 nextOffset 9 batches 1
2025-10-01T14:06:21.949419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-01T14:06:21.949423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1432 count 10 nextOffset 10 batches 1
2025-10-01T14:06:21.949426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-01T14:06:21.949431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1573 count 11 nextOffset 11 batches 1
2025-10-01T14:06:21.949434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-01T14:06:21.949438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1714 count 12 nextOffset 12 batches 1
2025-10-01T14:06:21.949441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-01T14:06:21.949446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1855 count 13 nextOffset 13 batches 1
2025-10-01T14:06:21.949448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-01T14:06:21.949452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1996 count 14 nextOffset 14 batches 1
2025-10-01T14:06:21.949456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-01T14:06:21.949460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2137 count 15 nextOffset 15 batches 1
2025-10-01T14:06:21.949464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-01T14:06:21.949468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2278 count 16 nextOffset 16 batches 1
2025-10-01T14:06:21.949472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-01T14:06:21.949479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2419 count 17 nextOffset 17 batches 1
2025-10-01T14:06:21.949482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-01T14:06:21.949486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2560 count 18 nextOffset 18 batches 1
2025-10-01T14:06:21.949489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-01T14:06:21.949493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2701 count 19 nextOffset 19 batches 1
2025-10-01T14:06:21.949498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-01T14:06:21.949504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2842 count 20 nextOffset 20 batches 1
2025-10-01T14:06:21.949508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-01T14:06:21.949512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2983 count 21 nextOffset 21 batches 1
2025-10-01T14:06:21.949516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-01T14:06:21.949519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3124 count 22 nextOffset 22 batches 1
2025-10-01T14:06:21.949523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.949622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,22 HeadOffset 0 endOffset 0 curOffset 22 d0000000000_00000000000000000000_00000_0000000022_00000? size 2458 WTime 1759327581946
2025-10-01T14:06:21.949657Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:21.949670Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 22 size 2458
2025-10-01T14:06:21.949683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-01T14:06:21.950610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:21.950892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.950902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.950919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.950997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-01T14:06:21.951103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:21.951145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:21.953492Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 71 to 71
2025-10-01T14:06:21.953545Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 72 to 72
2025-10-01T14:06:21.953557Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 73 to 73
2025-10-01T14:06:21.953563Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 74 to 74
2025-10-01T14:06:21.953572Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 75 to 75
2025-10-01T14:06:21.953578Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 76 to 76
2025-10-01T14:06:21.953586Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 77 to 77
2025-10-01T14:06:21.953591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 78 to 78
2025-10-01T14:06:21.953598Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 79 to 79
2025-10-01T14:06:21.953602Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 80 to 80
2025-10-01T14:06:21.953608Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 81 to 81
2025-10-01T14:06:21.953612Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 82 to 82
2025-10-01T14:06:21.953618Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 83 to 83
2025-10-01T14:06:21.953622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 84 to 84
2025-10-01T14:06:21.953627Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 85 to 85
2025-10-01T14:06:21.953633Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 86 to 86
2025-10-01T14:06:21.953638Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 87 to 87
2025-10-01T14:06:21.953642Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 88 to 88
2025-10-01T14:06:21.953649Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 89 to 89
2025-10-01T14:06:21.953655Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 90 to 90
2025-10-01T14:06:21.953659Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 91 to 91
2025-10-01T14:06:21.953663Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 92 to 92
2025-10-01T14:06:21.953669Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 93 to 93
2025-10-01T14:06:21.953673Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 94 to 94
2025-10-01T14:06:21.953677Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 95 to 95
2025-10-01T14:06:21.953682Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 96 to 96
2025-10-01T14:06:21.953688Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 97 to 97
2025-10-01T14:06:21.953692Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 98 to 98
2025-10-01T14:06:21.953696Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 99 to 99
2025-10-01T14:06:21.953701Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write 1 messages with Id from 100 to 100
2025-10-01T14:06:21.954081Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:21.954092Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Send 30 message(s) (0 left), first sequence number is 71
2025-10-01T14:06:21.954763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:21.954936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:21.955180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.955195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.955222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-01T14:06:21.955349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:21.955556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.955561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.955577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-01T14:06:21.955706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:21.955739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:21.966958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 22 size 2458 actorID [2:7556254422883036006:2401]
2025-10-01T14:06:21.966986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:21.967013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2322 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:21.967025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-01T14:06:21.967048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-01T14:06:21.967055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-01T14:06:21.967067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-01T14:06:21.967074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-01T14:06:21.967082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-01T14:06:21.967090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-01T14:06:21.967098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-01T14:06:21.967105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-01T14:06:21.967112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-01T14:06:21.967120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-01T14:06:21.967128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-01T14:06:21.967135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-01T14:06:21.967145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-01T14:06:21.967151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-01T14:06:21.967158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-01T14:06:21.967164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-01T14:06:21.967169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-01T14:06:21.967176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-01T14:06:21.967183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-01T14:06:21.967190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-01T14:06:21.967196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.967200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-01T14:06:21.967235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:21.967243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:21.967248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.967309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.967312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (78)
2025-10-01T14:06:21.967336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-01T14:06:21.967376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 173 count 1 nextOffset 23 batches 1
2025-10-01T14:06:21.967383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-01T14:06:21.967388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 314 count 2 nextOffset 24 batches 1
2025-10-01T14:06:21.967392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-01T14:06:21.967396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 455 count 3 nextOffset 25 batches 1
2025-10-01T14:06:21.967399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-01T14:06:21.967402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 596 count 4 nextOffset 26 batches 1
2025-10-01T14:06:21.967405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-01T14:06:21.967409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 737 count 5 nextOffset 27 batches 1
2025-10-01T14:06:21.967411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-01T14:06:21.967414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 878 count 6 nextOffset 28 batches 1
2025-10-01T14:06:21.967417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-01T14:06:21.967421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1019 count 7 nextOffset 29 batches 1
2025-10-01T14:06:21.967426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-01T14:06:21.967429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1160 count 8 nextOffset 30 batches 1
2025-10-01T14:06:21.967432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-01T14:06:21.967437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1301 count 9 nextOffset 31 batches 1
2025-10-01T14:06:21.967440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-01T14:06:21.967443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1442 count 10 nextOffset 32 batches 1
2025-10-01T14:06:21.967446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-01T14:06:21.967450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1583 count 11 nextOffset 33 batches 1
2025-10-01T14:06:21.967453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-01T14:06:21.967456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1724 count 12 nextOffset 34 batches 1
2025-10-01T14:06:21.967458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-01T14:06:21.967462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1865 count 13 nextOffset 35 batches 1
2025-10-01T14:06:21.967465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-01T14:06:21.967468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2006 count 14 nextOffset 36 batches 1
2025-10-01T14:06:21.967471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-01T14:06:21.967474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2147 count 15 nextOffset 37 batches 1
2025-10-01T14:06:21.967477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-01T14:06:21.967481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2288 count 16 nextOffset 38 batches 1
2025-10-01T14:06:21.967484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-01T14:06:21.967488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2429 count 17 nextOffset 39 batches 1
2025-10-01T14:06:21.967490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-01T14:06:21.967493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2570 count 18 nextOffset 40 batches 1
2025-10-01T14:06:21.967496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-01T14:06:21.967499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2711 count 19 nextOffset 41 batches 1
2025-10-01T14:06:21.967502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-01T14:06:21.967505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2852 count 20 nextOffset 42 batches 1
2025-10-01T14:06:21.967508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-01T14:06:21.967512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2993 count 21 nextOffset 43 batches 1
2025-10-01T14:06:21.967515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-01T14:06:21.967519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3134 count 22 nextOffset 44 batches 1
2025-10-01T14:06:21.967522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-01T14:06:21.967526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3275 count 23 nextOffset 45 batches 1
2025-10-01T14:06:21.967531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:06:21.967535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3416 count 24 nextOffset 46 batches 1
2025-10-01T14:06:21.967538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:06:21.967542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3557 count 25 nextOffset 47 batches 1
2025-10-01T14:06:21.967545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:06:21.967549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3698 count 26 nextOffset 48 batches 1
2025-10-01T14:06:21.967553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-01T14:06:21.967558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3839 count 27 nextOffset 49 batches 1
2025-10-01T14:06:21.967561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-01T14:06:21.967565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 3980 count 28 nextOffset 50 batches 1
2025-10-01T14:06:21.967569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-01T14:06:21.967572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4121 count 29 nextOffset 51 batches 1
2025-10-01T14:06:21.967576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-01T14:06:21.967580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4262 count 30 nextOffset 52 batches 1
2025-10-01T14:06:21.967584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-01T14:06:21.967587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4403 count 31 nextOffset 53 batches 1
2025-10-01T14:06:21.967590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-01T14:06:21.967594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4544 count 32 nextOffset 54 batches 1
2025-10-01T14:06:21.967597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-01T14:06:21.967615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4685 count 33 nextOffset 55 batches 1
2025-10-01T14:06:21.967618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-01T14:06:21.967622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4826 count 34 nextOffset 56 batches 1
2025-10-01T14:06:21.967625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-01T14:06:21.967628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4967 count 35 nextOffset 57 batches 1
2025-10-01T14:06:21.967631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-01T14:06:21.967635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5108 count 36 nextOffset 58 batches 1
2025-10-01T14:06:21.967638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-01T14:06:21.967642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5249 count 37 nextOffset 59 batches 1
2025-10-01T14:06:21.967645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-01T14:06:21.967649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5390 count 38 nextOffset 60 batches 1
2025-10-01T14:06:21.967652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-01T14:06:21.967655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5531 count 39 nextOffset 61 batches 1
2025-10-01T14:06:21.967660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-01T14:06:21.967664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5672 count 40 nextOffset 62 batches 1
2025-10-01T14:06:21.967667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-01T14:06:21.967670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5813 count 41 nextOffset 63 batches 1
2025-10-01T14:06:21.967674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-01T14:06:21.967678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 5954 count 42 nextOffset 64 batches 1
2025-10-01T14:06:21.967681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-01T14:06:21.967687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6095 count 43 nextOffset 65 batches 1
2025-10-01T14:06:21.967690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-01T14:06:21.967693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6236 count 44 nextOffset 66 batches 1
2025-10-01T14:06:21.967696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-01T14:06:21.967700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6377 count 45 nextOffset 67 batches 1
2025-10-01T14:06:21.967703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-01T14:06:21.967706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6518 count 46 nextOffset 68 batches 1
2025-10-01T14:06:21.967710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-01T14:06:21.967713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6659 count 47 nextOffset 69 batches 1
2025-10-01T14:06:21.967717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-01T14:06:21.967721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6800 count 48 nextOffset 70 batches 1
2025-10-01T14:06:21.967724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-01T14:06:21.967727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6941 count 49 nextOffset 71 batches 1
2025-10-01T14:06:21.967730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-01T14:06:21.967734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7082 count 50 nextOffset 72 batches 1
2025-10-01T14:06:21.967737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-01T14:06:21.967740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7223 count 51 nextOffset 73 batches 1
2025-10-01T14:06:21.967743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-01T14:06:21.967747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7364 count 52 nextOffset 74 batches 1
2025-10-01T14:06:21.967751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-01T14:06:21.967755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7505 count 53 nextOffset 75 batches 1
2025-10-01T14:06:21.967758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-01T14:06:21.967762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7646 count 54 nextOffset 76 batches 1
2025-10-01T14:06:21.967765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-01T14:06:21.967769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7787 count 55 nextOffset 77 batches 1
2025-10-01T14:06:21.967773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-01T14:06:21.967777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 7928 count 56 nextOffset 78 batches 1
2025-10-01T14:06:21.967780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-01T14:06:21.967784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8069 count 57 nextOffset 79 batches 1
2025-10-01T14:06:21.967787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-01T14:06:21.967790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8210 count 58 nextOffset 80 batches 1
2025-10-01T14:06:21.967793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-01T14:06:21.967797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8351 count 59 nextOffset 81 batches 1
2025-10-01T14:06:21.967800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-01T14:06:21.967803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8492 count 60 nextOffset 82 batches 1
2025-10-01T14:06:21.967806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-01T14:06:21.967810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8633 count 61 nextOffset 83 batches 1
2025-10-01T14:06:21.967813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-01T14:06:21.967817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8774 count 62 nextOffset 84 batches 1
2025-10-01T14:06:21.967820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-01T14:06:21.967823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 8915 count 63 nextOffset 85 batches 1
2025-10-01T14:06:21.967826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-01T14:06:21.967830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9056 count 64 nextOffset 86 batches 1
2025-10-01T14:06:21.967833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-01T14:06:21.967842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9197 count 65 nextOffset 87 batches 1
2025-10-01T14:06:21.967845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-01T14:06:21.967850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9338 count 66 nextOffset 88 batches 1
2025-10-01T14:06:21.967853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-01T14:06:21.967856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9479 count 67 nextOffset 89 batches 1
2025-10-01T14:06:21.967859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-01T14:06:21.967863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9620 count 68 nextOffset 90 batches 1
2025-10-01T14:06:21.967867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-01T14:06:21.967871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9761 count 69 nextOffset 91 batches 1
2025-10-01T14:06:21.967874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-01T14:06:21.967877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 9902 count 70 nextOffset 92 batches 1
2025-10-01T14:06:21.967880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-01T14:06:21.967884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10043 count 71 nextOffset 93 batches 1
2025-10-01T14:06:21.967889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-01T14:06:21.967893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10184 count 72 nextOffset 94 batches 1
2025-10-01T14:06:21.967897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-01T14:06:21.967900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10325 count 73 nextOffset 95 batches 1
2025-10-01T14:06:21.967903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-01T14:06:21.967906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10466 count 74 nextOffset 96 batches 1
2025-10-01T14:06:21.967910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-01T14:06:21.967915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10607 count 75 nextOffset 97 batches 1
2025-10-01T14:06:21.967918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-01T14:06:21.967923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10748 count 76 nextOffset 98 batches 1
2025-10-01T14:06:21.967926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-01T14:06:21.967930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 10889 count 77 nextOffset 99 batches 1
2025-10-01T14:06:21.967933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-01T14:06:21.967938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 11030 count 78 nextOffset 100 batches 1
2025-10-01T14:06:21.967942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.968038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 22,78 HeadOffset 22 endOffset 22 curOffset 100 d0000000000_00000000000000000022_00000_0000000078_00000? size 8516 WTime 1759327581966
2025-10-01T14:06:21.968077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000022_00000?
2025-10-01T14:06:21.968081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2458 bytes (2458)
2025-10-01T14:06:21.968086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2458 (8388608)
2025-10-01T14:06:21.968161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:06:21.968188Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:21.968200Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 78 size 8516
2025-10-01T14:06:21.968264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 22 max time lag 0ms effective offset 0
2025-10-01T14:06:21.968277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2458 count 22 last offset 0, current partition end offset: 22
2025-10-01T14:06:21.968282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:21.968311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 22 parts_count 0 source 1 size 2458 accessed 0 times before, last time 2025-10-01T14:06:21.000000Z
2025-10-01T14:06:21.968314Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-01T14:06:21.968327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:21.968395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 22 count 22 size 2438 from pos 0 cbcount 22
2025-10-01T14:06:21.968413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327581946 queuesize 0 startOffset 0
2025-10-01T14:06:21.969619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:21.970299Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:21.970522Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } acks { seq_no: 2 written { offset: 1 } } acks { seq_no: 3 written { offset: 2 } } acks { seq_no: 4 written { offset: 3 } } acks { seq_no: 5 written { offset: 4 } } acks { seq_no: 6 written { offset: 5 } } acks { seq_no: 7 written { offset: 6 } } acks { seq_no: 8 written { offset: 7 } } acks { seq_no: 9 written { offset: 8 } } acks { seq_no: 10 written { offset: 9 } } acks { seq_no: 11 written { offset: 10 } } acks { seq_no: 12 written { offset: 11 } } acks { seq_no: 13 written { offset: 12 } } acks { seq_no: 14 written { offset: 13 } } acks { seq_no: 15 written { offset: 14 } } acks { seq_no: 16 written { offset: 15 } } acks { seq_no: 17 written { offset: 16 } } acks { seq_no: 18 written { offset: 17 } } acks { seq_no: 19 written { offset: 18 } } acks { seq_no: 20 written { offset: 19 } } acks { seq_no: 21 written { offset: 20 } } acks { seq_no: 22 written { offset: 21 } } write_statistics { persisting_time { nanos: 19000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:21.970536Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-01T14:06:21.970541Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-01T14:06:21.970547Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-01T14:06:21.970549Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 2
2025-10-01T14:06:21.970556Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=3, txId=?
2025-10-01T14:06:21.970559Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 3
2025-10-01T14:06:21.970563Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=4, txId=?
2025-10-01T14:06:21.970565Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 4
2025-10-01T14:06:21.970568Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=5, txId=?
2025-10-01T14:06:21.970571Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 5
2025-10-01T14:06:21.970574Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=6, txId=?
2025-10-01T14:06:21.970576Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 6
2025-10-01T14:06:21.970579Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=7, txId=?
2025-10-01T14:06:21.970581Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 7
2025-10-01T14:06:21.970584Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=8, txId=?
2025-10-01T14:06:21.970586Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 8
2025-10-01T14:06:21.970590Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=9, txId=?
2025-10-01T14:06:21.970595Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 9
2025-10-01T14:06:21.970598Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=10, txId=?
2025-10-01T14:06:21.970600Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 10
2025-10-01T14:06:21.970603Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=11, txId=?
2025-10-01T14:06:21.970605Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 11
2025-10-01T14:06:21.970608Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=12, txId=?
2025-10-01T14:06:21.970610Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 12
2025-10-01T14:06:21.970614Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=13, txId=?
2025-10-01T14:06:21.970616Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 13
2025-10-01T14:06:21.970619Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=14, txId=?
2025-10-01T14:06:21.970622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 14
2025-10-01T14:06:21.970625Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=15, txId=?
2025-10-01T14:06:21.970627Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 15
2025-10-01T14:06:21.970630Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=16, txId=?
2025-10-01T14:06:21.970633Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 16
2025-10-01T14:06:21.970636Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=17, txId=?
2025-10-01T14:06:21.970638Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 17
2025-10-01T14:06:21.970641Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=18, txId=?
2025-10-01T14:06:21.970644Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 18
2025-10-01T14:06:21.970647Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=19, txId=?
2025-10-01T14:06:21.970649Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 19
2025-10-01T14:06:21.970653Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=20, txId=?
2025-10-01T14:06:21.970655Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 20
2025-10-01T14:06:21.970658Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=21, txId=?
2025-10-01T14:06:21.970662Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 21
2025-10-01T14:06:21.970665Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=22, txId=?
2025-10-01T14:06:21.970667Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 22
2025-10-01T14:06:21.969215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 22 parts 0 suffix '63' size 2458
2025-10-01T14:06:21.969231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 22 parts 0 suffix '63'
2025-10-01T14:06:21.974625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:21.986602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 78 size 8516 actorID [2:7556254422883036006:2401]
2025-10-01T14:06:21.986630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:21.986654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 8268 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:21.986665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-01T14:06:21.986682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-01T14:06:21.986689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-01T14:06:21.986697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-01T14:06:21.986704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-01T14:06:21.986712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-01T14:06:21.986722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-01T14:06:21.986728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-01T14:06:21.986737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-01T14:06:21.986744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-01T14:06:21.986752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-01T14:06:21.986762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-01T14:06:21.986768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-01T14:06:21.986773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-01T14:06:21.986780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-01T14:06:21.986803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-01T14:06:21.986809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-01T14:06:21.986815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-01T14:06:21.986821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-01T14:06:21.986826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-01T14:06:21.986835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-01T14:06:21.986841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-01T14:06:21.986850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-01T14:06:21.986856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-01T14:06:21.986861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-01T14:06:21.986867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-01T14:06:21.986872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-01T14:06:21.986877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-01T14:06:21.986883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-01T14:06:21.986889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-01T14:06:21.986896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-01T14:06:21.986901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-01T14:06:21.986906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-01T14:06:21.986911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-01T14:06:21.986918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-01T14:06:21.986924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-01T14:06:21.986930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-01T14:06:21.986937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-01T14:06:21.986943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-01T14:06:21.986949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-01T14:06:21.986954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-01T14:06:21.986959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-01T14:06:21.986965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-01T14:06:21.986971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-01T14:06:21.986977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-01T14:06:21.986984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-01T14:06:21.986992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.986996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-01T14:06:21.986998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-01T14:06:21.987005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-01T14:06:21.987010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-01T14:06:21.987015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-01T14:06:21.987021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-01T14:06:21.987029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-01T14:06:21.987034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-01T14:06:21.987041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-01T14:06:21.987047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-01T14:06:21.987053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-01T14:06:21.987058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-01T14:06:21.987064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-01T14:06:21.987069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-01T14:06:21.987076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-01T14:06:21.987081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-01T14:06:21.987090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-01T14:06:21.987096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-01T14:06:21.987104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-01T14:06:21.987110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-01T14:06:21.987115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-01T14:06:21.987122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-01T14:06:21.987128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-01T14:06:21.987134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-01T14:06:21.987140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-01T14:06:21.987146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-01T14:06:21.987151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-01T14:06:21.987156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-01T14:06:21.987163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-01T14:06:21.987171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-01T14:06:21.987177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-01T14:06:21.987182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:21.987188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-01T14:06:21.987225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.987228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.987230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.987242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000022_00000?
2025-10-01T14:06:21.987244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000078_00000?
2025-10-01T14:06:21.987247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 10974 bytes (10974)
2025-10-01T14:06:21.987251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 10974 (8388608)
2025-10-01T14:06:21.987327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-01T14:06:21.987374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-01T14:06:21.988140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:21.988196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:21.988828Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:21.988977Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 23 written { offset: 22 } } acks { seq_no: 24 written { offset: 23 } } acks { seq_no: 25 written { offset: 24 } } acks { seq_no: 26 written { offset: 25 } } acks { seq_no: 27 written { offset: 26 } } acks { seq_no: 28 written { offset: 27 } } acks { seq_no: 29 written { offset: 28 } } acks { seq_no: 30 written { offset: 29 } } acks { seq_no: 31 written { offset: 30 } } acks { seq_no: 32 written { offset: 31 } } acks { seq_no: 33 written { offset: 32 } } acks { seq_no: 34 written { offset: 33 } } acks { seq_no: 35 written { offset: 34 } } acks { seq_no: 36 written { offset: 35 } } acks { seq_no: 37 written { offset: 36 } } acks { seq_no: 38 written { offset: 37 } } acks { seq_no: 39 written { offset: 38 } } acks { seq_no: 40 written { offset: 39 } } acks { seq_no: 41 written { offset: 40 } } acks { seq_no: 42 written { offset: 41 } } acks { seq_no: 43 written { offset: 42 } } acks { seq_no: 44 written { offset: 43 } } acks { seq_no: 45 written { offset: 44 } } acks { seq_no: 46 written { offset: 45 } } acks { seq_no: 47 written { offset: 46 } } acks { seq_no: 48 written { offset: 47 } } acks { seq_no: 49 written { offset: 48 } } acks { seq_no: 50 written { offset: 49 } } acks { seq_no: 51 written { offset: 50 } } acks { seq_no: 52 written { offset: 51 } } acks { seq_no: 53 written { offset: 52 } } acks { seq_no: 54 written { offset: 53 } } acks { seq_no: 55 written { offset: 54 } } acks { seq_no: 56 written { offset: 55 } } acks { seq_no: 57 written { offset: 56 } } acks { seq_no: 58 written { offset: 57 } } acks { seq_no: 59 written { offset: 58 } } acks { seq_no: 60 written { offset: 59 } } acks { seq_no: 61 written { offset: 60 } } acks { seq_no: 62 written { offset: 61 } } acks { seq_no: 63 written { offset: 62 } } acks { seq_no: 64 written { offset: 63 } } acks { seq_no: 65 written { offset: 64 } } acks { seq_no: 66 written { offset: 65 } } acks { seq_no: 67 written { offset: 66 } } acks { seq_no: 68 written { offset: 67 } } acks { seq_no: 69 written { offset: 68 } } acks { seq_no: 70 written { offset: 69 } } write_statistics { persisting_time { nanos: 20000000 } min_queue_wait_time { nanos: 15000000 } max_queue_wait_time { nanos: 15000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:21.988985Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=23, txId=?
2025-10-01T14:06:21.988989Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 23
2025-10-01T14:06:21.988995Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=24, txId=?
2025-10-01T14:06:21.988997Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 24
2025-10-01T14:06:21.989002Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=25, txId=?
2025-10-01T14:06:21.989005Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 25
2025-10-01T14:06:21.989011Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=26, txId=?
2025-10-01T14:06:21.989013Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 26
2025-10-01T14:06:21.989016Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=27, txId=?
2025-10-01T14:06:21.989019Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 27
2025-10-01T14:06:21.989022Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=28, txId=?
2025-10-01T14:06:21.989024Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 28
2025-10-01T14:06:21.989027Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=29, txId=?
2025-10-01T14:06:21.989030Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 29
2025-10-01T14:06:21.989033Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=30, txId=?
2025-10-01T14:06:21.989035Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 30
2025-10-01T14:06:21.989038Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=31, txId=?
2025-10-01T14:06:21.989040Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 31
2025-10-01T14:06:21.989043Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=32, txId=?
2025-10-01T14:06:21.989045Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 32
2025-10-01T14:06:21.989049Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=33, txId=?
2025-10-01T14:06:21.989051Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 33
2025-10-01T14:06:21.989054Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=34, txId=?
2025-10-01T14:06:21.989056Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 34
2025-10-01T14:06:21.989059Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=35, txId=?
2025-10-01T14:06:21.989061Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 35
2025-10-01T14:06:21.989065Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=36, txId=?
2025-10-01T14:06:21.989067Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 36
2025-10-01T14:06:21.989070Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=37, txId=?
2025-10-01T14:06:21.989073Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 37
2025-10-01T14:06:21.989077Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=38, txId=?
2025-10-01T14:06:21.989079Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 38
2025-10-01T14:06:21.989082Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=39, txId=?
2025-10-01T14:06:21.989084Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 39
2025-10-01T14:06:21.989087Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=40, txId=?
2025-10-01T14:06:21.989089Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 40
2025-10-01T14:06:21.989092Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=41, txId=?
2025-10-01T14:06:21.989095Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 41
2025-10-01T14:06:21.989098Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=42, txId=?
2025-10-01T14:06:21.989100Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 42
2025-10-01T14:06:21.989103Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=43, txId=?
2025-10-01T14:06:21.989105Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 43
2025-10-01T14:06:21.989108Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=44, txId=?
2025-10-01T14:06:21.989110Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 44
2025-10-01T14:06:21.989113Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=45, txId=?
2025-10-01T14:06:21.989115Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 45
2025-10-01T14:06:21.989118Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=46, txId=?
2025-10-01T14:06:21.989120Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 46
2025-10-01T14:06:21.989123Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=47, txId=?
2025-10-01T14:06:21.989125Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 47
2025-10-01T14:06:21.989128Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=48, txId=?
2025-10-01T14:06:21.989130Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 48
2025-10-01T14:06:21.989133Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=49, txId=?
2025-10-01T14:06:21.989135Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 49
2025-10-01T14:06:21.989139Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=50, txId=?
2025-10-01T14:06:21.989142Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 50
2025-10-01T14:06:21.989145Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=51, txId=?
2025-10-01T14:06:21.989147Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 51
2025-10-01T14:06:21.989150Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=52, txId=?
2025-10-01T14:06:21.989152Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 52
2025-10-01T14:06:21.989155Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=53, txId=?
2025-10-01T14:06:21.989157Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 53
2025-10-01T14:06:21.989161Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=54, txId=?
2025-10-01T14:06:21.989163Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 54
2025-10-01T14:06:21.989166Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=55, txId=?
2025-10-01T14:06:21.989168Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 55
2025-10-01T14:06:21.989171Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=56, txId=?
2025-10-01T14:06:21.989173Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 56
2025-10-01T14:06:21.989176Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=57, txId=?
2025-10-01T14:06:21.989178Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 57
2025-10-01T14:06:21.989181Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=58, txId=?
2025-10-01T14:06:21.989184Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 58
2025-10-01T14:06:21.989187Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=59, txId=?
2025-10-01T14:06:21.989189Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 59
2025-10-01T14:06:21.989191Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=60, txId=?
2025-10-01T14:06:21.989194Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 60
2025-10-01T14:06:21.989197Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=61, txId=?
2025-10-01T14:06:21.989199Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 61
2025-10-01T14:06:21.989204Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=62, txId=?
2025-10-01T14:06:21.989206Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 62
2025-10-01T14:06:21.989209Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=63, txId=?
2025-10-01T14:06:21.989211Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 63
2025-10-01T14:06:21.989214Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=64, txId=?
2025-10-01T14:06:21.989216Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 64
2025-10-01T14:06:21.989219Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=65, txId=?
2025-10-01T14:06:21.989221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 65
2025-10-01T14:06:21.989225Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=66, txId=?
2025-10-01T14:06:21.989227Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 66
2025-10-01T14:06:21.989230Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=67, txId=?
2025-10-01T14:06:21.989232Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 67
2025-10-01T14:06:21.989235Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=68, txId=?
2025-10-01T14:06:21.989237Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 68
2025-10-01T14:06:21.989240Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=69, txId=?
2025-10-01T14:06:21.989242Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 69
2025-10-01T14:06:21.989245Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=70, txId=?
2025-10-01T14:06:21.989247Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 70
2025-10-01T14:06:21.989310Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:21.989365Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 71 written { offset: 70 } } acks { seq_no: 72 written { offset: 71 } } acks { seq_no: 73 written { offset: 72 } } acks { seq_no: 74 written { offset: 73 } } acks { seq_no: 75 written { offset: 74 } } acks { seq_no: 76 written { offset: 75 } } acks { seq_no: 77 written { offset: 76 } } acks { seq_no: 78 written { offset: 77 } } acks { seq_no: 79 written { offset: 78 } } acks { seq_no: 80 written { offset: 79 } } acks { seq_no: 81 written { offset: 80 } } acks { seq_no: 82 written { offset: 81 } } acks { seq_no: 83 written { offset: 82 } } acks { seq_no: 84 written { offset: 83 } } acks { seq_no: 85 written { offset: 84 } } acks { seq_no: 86 written { offset: 85 } } acks { seq_no: 87 written { offset: 86 } } acks { seq_no: 88 written { offset: 87 } } acks { seq_no: 89 written { offset: 88 } } acks { seq_no: 90 written { offset: 89 } } acks { seq_no: 91 written { offset: 90 } } acks { seq_no: 92 written { offset: 91 } } acks { seq_no: 93 written { offset: 92 } } acks { seq_no: 94 written { offset: 93 } } acks { seq_no: 95 written { offset: 94 } } acks { seq_no: 96 written { offset: 95 } } acks { seq_no: 97 written { offset: 96 } } acks { seq_no: 98 written { offset: 97 } } acks { seq_no: 99 written { offset: 98 } } acks { seq_no: 100 written { offset: 99 } } write_statistics { persisting_time { nanos: 20000000 } min_queue_wait_time { nanos: 12000000 } max_queue_wait_time { nanos: 12000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:21.989372Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=71, txId=?
2025-10-01T14:06:21.989374Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 71
2025-10-01T14:06:21.989377Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=72, txId=?
2025-10-01T14:06:21.989379Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 72
2025-10-01T14:06:21.989382Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=73, txId=?
2025-10-01T14:06:21.989384Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 73
2025-10-01T14:06:21.989387Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=74, txId=?
2025-10-01T14:06:21.989390Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 74
2025-10-01T14:06:21.989393Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=75, txId=?
2025-10-01T14:06:21.989395Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 75
2025-10-01T14:06:21.989398Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=76, txId=?
2025-10-01T14:06:21.989401Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 76
2025-10-01T14:06:21.989404Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=77, txId=?
2025-10-01T14:06:21.989406Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 77
2025-10-01T14:06:21.989409Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=78, txId=?
2025-10-01T14:06:21.989413Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 78
2025-10-01T14:06:21.989416Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=79, txId=?
2025-10-01T14:06:21.989418Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 79
2025-10-01T14:06:21.989421Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=80, txId=?
2025-10-01T14:06:21.989423Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 80
2025-10-01T14:06:21.989426Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=81, txId=?
2025-10-01T14:06:21.989428Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 81
2025-10-01T14:06:21.989431Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=82, txId=?
2025-10-01T14:06:21.989433Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 82
2025-10-01T14:06:21.989436Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=83, txId=?
2025-10-01T14:06:21.989438Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 83
2025-10-01T14:06:21.989441Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=84, txId=?
2025-10-01T14:06:21.989443Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 84
2025-10-01T14:06:21.989446Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=85, txId=?
2025-10-01T14:06:21.989448Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 85
2025-10-01T14:06:21.989451Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=86, txId=?
2025-10-01T14:06:21.989453Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 86
2025-10-01T14:06:21.989456Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=87, txId=?
2025-10-01T14:06:21.989459Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 87
2025-10-01T14:06:21.989462Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=88, txId=?
2025-10-01T14:06:21.989464Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 88
2025-10-01T14:06:21.989467Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=89, txId=?
2025-10-01T14:06:21.989469Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 89
2025-10-01T14:06:21.989472Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=90, txId=?
2025-10-01T14:06:21.987923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 78 parts 0 suffix '63' size 8516
2025-10-01T14:06:21.989476Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 90
2025-10-01T14:06:21.989547Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=91, txId=?
2025-10-01T14:06:21.989549Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 91
2025-10-01T14:06:21.989552Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=92, txId=?
2025-10-01T14:06:21.989554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 92
2025-10-01T14:06:21.989558Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=93, txId=?
2025-10-01T14:06:21.989560Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 93
2025-10-01T14:06:21.989563Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=94, txId=?
2025-10-01T14:06:21.989565Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 94
2025-10-01T14:06:21.989568Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=95, txId=?
2025-10-01T14:06:21.989571Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 95
2025-10-01T14:06:21.989574Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=96, txId=?
2025-10-01T14:06:21.989576Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 96
2025-10-01T14:06:21.989579Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=97, txId=?
2025-10-01T14:06:21.989581Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 97
2025-10-01T14:06:21.989584Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=98, txId=?
2025-10-01T14:06:21.989586Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 98
2025-10-01T14:06:21.989589Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=99, txId=?
2025-10-01T14:06:21.989591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 99
2025-10-01T14:06:21.989594Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] OnAck: seqNo=100, txId=?
2025-10-01T14:06:21.989596Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: acknoledged message 100
2025-10-01T14:06:21.989701Z :INFO: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-01T14:06:21.989707Z :INFO: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session will now close
2025-10-01T14:06:21.989715Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:06:21.989802Z :INFO: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:21.989806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0]  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:06:21.990099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 grpc read done: success: 0 data: 
2025-10-01T14:06:21.990108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 grpc read failed
2025-10-01T14:06:21.990116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 grpc closed
2025-10-01T14:06:21.990122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|14e2e769-385bcd8d-aa381ebc-6e80ad2d_0 is DEAD
2025-10-01T14:06:21.990297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:21.992805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254427181633187:2504] destroyed
2025-10-01T14:06:21.992832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:21.992842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.992845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.992847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.424211Z :WriteSessionCloseIgnoresWrites INFO: Random seed for debugging is 1759327582424204
2025-10-01T14:06:22.513654Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556254430323712362:2087];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:22.513809Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:22.515372Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:22.515534Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/tmp0cTlBL/pdisk_1.dat
2025-10-01T14:06:22.518490Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-01T14:06:22.518962Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:22.518989Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:22.538282Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:22.538304Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:22.540959Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:22.543984Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:06:22.544473Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 8883, node 3
2025-10-01T14:06:22.553487Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/yandexZzYNHt.tmp
2025-10-01T14:06:22.553498Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/yandexZzYNHt.tmp
2025-10-01T14:06:22.553564Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/0047a6/r3tmp/yandexZzYNHt.tmp
2025-10-01T14:06:22.553604Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:22.556429Z INFO: TTestServer started on Port 22055 GrpcPort 8883
TClient is connected to server localhost:22055
PQClient connected to localhost:8883
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:22.615569Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:22.615618Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:22.617247Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:22.617422Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-01T14:06:22.621348Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
waiting...
2025-10-01T14:06:22.630672Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720658, at schemeshard: 72057594046644480
waiting...
waiting...
2025-10-01T14:06:22.752900Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:22.800709Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:22.954828Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254430323713273:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.954867Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.955007Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254430323713285:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.955020Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254430323713286:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.955025Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.955837Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:22.963430Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254430323713321:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.963578Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.965690Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:22.971330Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556254430323713289:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:23.006623Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:23.006674Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556254431094346136:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:23.007374Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=NDcwMzU3ZTctZDBiNDg3MjYtN2U0NDEyNWMtNDAxYTQzOTc=, ActorId: [4:7556254431094346103:2294], ActorState: ExecuteState, TraceId: 01k6g1gyrq7mqk9efhzgcvxhqs, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:23.007518Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:23.038953Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556254434618680921:2864] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:23.045045Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556254434618680933:2350], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:23.045843Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=ZjNmZDlmMi00ZmJkOTQ5NC04Y2IyNzczYS02N2MwMDM3Mg==, ActorId: [3:7556254430323713270:2323], ActorState: ExecuteState, TraceId: 01k6g1gyq9a7cd7awn6s324z19, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:23.045973Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:23.048653Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:8883", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:23.102133Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gyv75fd2mstfs19ca7ek, Database: , SessionId: ydb://session/3?node_id=3&id=OGVhMjE1ZDgtYWNlZDI3NDUtZTVhMmUzNDYtNzA2ZmU5MzQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254434618681139:3008] 
2025-10-01T14:06:23.514965Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:23.518426Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:27.514188Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556254430323712362:2087];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:27.514219Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:28.287273Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:8883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:8883
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:28.323105Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-01T14:06:28.335212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:28.336123Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:28.336186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:28.336193Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.336202Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:28.336479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254456093518204:3348], now have 1 active actors on pipe
2025-10-01T14:06:28.336591Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.337777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.339255Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254456093518206:3350] connected; active server actors: 1
2025-10-01T14:06:28.339675Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:28.339861Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:28.340418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556254456864150347:2378], now have 1 active actors on pipe
2025-10-01T14:06:28.340629Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:28.340646Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-01T14:06:28.342356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254456093518268:3400], now have 1 active actors on pipe
2025-10-01T14:06:28.342462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.343548Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.343718Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:28.343734Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:28.343803Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:28.343836Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556254456093518279:2472]
2025-10-01T14:06:28.344579Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:28.344582Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:28.344588Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556254456093518279:2472]
2025-10-01T14:06:28.344594Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:28.344871Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:28.344877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.344894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.344897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.344900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:28.344903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.344904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.344906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:28.344912Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.344992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.345021Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:28.345406Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1h3z84jjy04s7v48q00sf, Database: , SessionId: ydb://session/3?node_id=3&id=YWQyOGQzZGItZTA0OWI3NjUtNTBhMzMwZDgtMWJmYTBkNTU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:28.346157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.346186Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327588389, TxId 281474976720679
2025-10-01T14:06:28.346190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.346192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.346213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.346248Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:28.347362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:28.347415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:28.347422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.347424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.347425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.347431Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:28.347529Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:28.347546Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.347583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.349418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.349441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.349955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327588389
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327588389
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:8883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.353719Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:28.445007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.445025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.445028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.545471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.545486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.545489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.645717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.645739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.645742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.746070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.746085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.746088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.846435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.846457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.846461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:8883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.858864Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:28.947010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.947028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.947031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.047124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.047143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.047145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.147477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.147495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.147499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.249609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.249627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.249630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.349710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.349725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.349727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:8883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:29.360483Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:29.361659Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:29.361888Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:29.361895Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:8883
2025-10-01T14:06:29.362233Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:29.362293Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.362307Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:29.362423Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:29.362457Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34806
2025-10-01T14:06:29.362461Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34806 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.362464Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.362772Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:29.362795Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.362801Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.362803Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.362807Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.363199Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.378916Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:29.379062Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254460388485811:2509] connected; active server actors: 1
2025-10-01T14:06:29.379140Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:29.379147Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.379271Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254460388485811:2509] disconnected; active server actors: 1
2025-10-01T14:06:29.379282Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254460388485811:2509] disconnected no session
2025-10-01T14:06:29.393655Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.393668Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:29.393672Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254460388485780:2509] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.393680Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.393808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:06:29.393813Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254460388485831:2509], now have 1 active actors on pipe
2025-10-01T14:06:29.393820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.393825Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.393852Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:29.393869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.393873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.393875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.393884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.393896Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.393914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.393950Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.393959Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.393978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.394009Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0
2025-10-01T14:06:29.394344Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327589394 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:29.394412Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.394568Z :INFO: [] MessageGroupId [src] SessionId [src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:29.394578Z :INFO: [] MessageGroupId [src] SessionId [src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0] Write session will now close
2025-10-01T14:06:29.394584Z :DEBUG: [] MessageGroupId [src] SessionId [src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0] Write session: aborting
2025-10-01T14:06:29.394735Z :INFO: [] MessageGroupId [src] SessionId [src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:29.394740Z :DEBUG: [] MessageGroupId [src] SessionId [src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0] Write session: destroy
2025-10-01T14:06:29.394876Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0 grpc read done: success: 0 data: 
2025-10-01T14:06:29.394885Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0 grpc read failed
2025-10-01T14:06:29.394891Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0 grpc closed
2025-10-01T14:06:29.394896Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|e3b5e222-cf2d7ad1-d0813109-1f0022ec_0 is DEAD
2025-10-01T14:06:29.395127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:29.395169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254460388485831:2509] destroyed
2025-10-01T14:06:29.395181Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:29.395186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.395188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.395190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-01T14:06:29.450090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.450106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.450109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.450274Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: UNAVAILABLE. Description: 
2025-10-01T14:06:29.550440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.550459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.550462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.650796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.650813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.650816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.751156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.751174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.751177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.851490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.851514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.851516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.951788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.951802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.951805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.052182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.052208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.052210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.152536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.152547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.152550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.252877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.252891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.252893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.353248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.353260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.353262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.453602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.453620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.453623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.555003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.555022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.555025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.654308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.654327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.654331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.754658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.754672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.754675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.854999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.855012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.855014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.956049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.956065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.956068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.056231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.056251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.056254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.156557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.156571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.156574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.256947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.256967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.256971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.357263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.357278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.357280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.457612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.457629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.457631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.557975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.557992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.557994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.658325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.658340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.658343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.758679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.758696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.758699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.859514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.859532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.859535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.959818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.959833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.959835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.060250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.060267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.060271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.160601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.160620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.160622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.260959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.260978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.260981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.361306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.361324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.361327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.461633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.461650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.461652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.561999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.562016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.562020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.662386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.662406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.662409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:14.046414Z :WriteSessionNoAvailableDatabase INFO: Random seed for debugging is 1759327574046407
2025-10-01T14:06:14.219151Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254395071818531:2264];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:14.219170Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:14.226969Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/tmpPQQnEe/pdisk_1.dat
2025-10-01T14:06:14.229936Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:14.265869Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.273509Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.273585Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-01T14:06:14.273605Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 11046, node 1
2025-10-01T14:06:14.309806Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/yandexENFE1G.tmp
2025-10-01T14:06:14.309819Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/yandexENFE1G.tmp
2025-10-01T14:06:14.309889Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/yandexENFE1G.tmp
2025-10-01T14:06:14.309932Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:14.312277Z INFO: TTestServer started on Port 17603 GrpcPort 11046
2025-10-01T14:06:14.322504Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.322534Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TClient is connected to server localhost:17603
PQClient connected to localhost:11046
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-10-01T14:06:14.330780Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.330811Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:14.331090Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:14.338366Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:14.339802Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:14.348978Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:14.465175Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:14.542403Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:14.625953Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254395094485699:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.625987Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254395094485688:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.626068Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.626235Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254395071819272:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.626260Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254395071819246:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.626282Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.627263Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:14.627756Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254395071819305:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.627769Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.627843Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254395071819314:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.627848Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.628364Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254395094485729:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.628391Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.628435Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254395094485731:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.628449Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.631217Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254395094485703:2130] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.634117Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254395071819275:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:14.634153Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556254395094485702:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:14.665260Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:14.684724Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:14.702224Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11046", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:14.726996Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254395094485839:2206] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.736432Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254395071819729:2949] txid# 281474976720665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.748519Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gpp1bzrfjrkm5ynj72yc, Database: , SessionId: ydb://session/3?node_id=1&id=ZjQ3NzYzNjMtNzNiZDg3OC1mZTU2YTE1LTZjOTM2Mjll, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254395071819773:2970] 
2025-10-01T14:06:15.219395Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:15.228584Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:19.219133Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254395071818531:2264];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:19.219176Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:19.992078Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11046
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.014189Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11046
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.021285Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254420841624108:3292] connected; active server actors: 1
2025-10-01T14:06:20.021427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.021544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.021792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.025382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.025925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.025985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.025994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.026011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.026112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254420841624107:3291], now have 1 active actors on pipe
2025-10-01T14:06:20.026123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254420841624130:2460], now have 1 active actors on pipe
2025-10-01T14:06:20.026169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:20.026325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.031330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.034174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254420841624166:3338], now have 1 active actors on pipe
2025-10-01T14:06:20.034274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.035319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.035460Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720683. Ctx: { TraceId: 01k6g1gvvmaf5ty4jk3k857we7, Database: , SessionId: ydb://session/3?node_id=1&id=MzRmM2UyOGMtMzI0NDFlYWEtMjU0Zjc0NTItZmE2YzE3, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:20.035547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.035574Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.035646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.035734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254420864290132:2411]
2025-10-01T14:06:20.036382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.036397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.036402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254420864290132:2411]
2025-10-01T14:06:20.036409Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.036723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.036735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.036763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.036770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.036774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.036776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.036778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.036779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.036786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.036932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.036980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.037870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.037903Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580080, TxId 281474976720682
2025-10-01T14:06:20.037911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.037916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.037937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.037979Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.038555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.038614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.038625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.038627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.038628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.038634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.038743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.038765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.038807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-01T14:06:20.040255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.040277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
TClient::Ls response: 2025-10-01T14:06:20.040886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759327580080
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759327580080
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11046
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.042109Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.137148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.137160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.137163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.237490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.237505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.237508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.339773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.339794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.339798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.440261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.440277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.440280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.540599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.540614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.540617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11046
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.543325Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.640961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.640974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.640977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.741332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.741355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.741358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.841644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.841655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.841657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.941950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.941962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.941964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.042361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.042390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.042393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11046
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.047302Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.050002Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.050259Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.050267Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11046
2025-10-01T14:06:21.053235Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.053207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.053221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.053969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.054011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37142
2025-10-01T14:06:21.054016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37142 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.054019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.055325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.055370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.055372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.055374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.055378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.055835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.085414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.085570Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254425136591671:2495] connected; active server actors: 1
2025-10-01T14:06:21.085584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:21.085587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.085676Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254425136591671:2495] disconnected; active server actors: 1
2025-10-01T14:06:21.085682Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254425136591671:2495] disconnected no session
2025-10-01T14:06:21.110996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:21.111012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:21.111016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254425136591637:2495] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:21.111027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:21.114479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254425136591693:2495], now have 1 active actors on pipe
2025-10-01T14:06:21.114624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:21.114812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.114828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.114864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|240acb54-e0f6d844-e78dec50-3daa4741_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:21.114879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.114887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.114890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.114905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.114925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:21.114949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.115301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.115313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.115331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.115454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|240acb54-e0f6d844-e78dec50-3daa4741_0
2025-10-01T14:06:21.117184Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327581117 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.117232Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|240acb54-e0f6d844-e78dec50-3daa4741_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:21.117443Z :INFO: [] MessageGroupId [src] SessionId [src|240acb54-e0f6d844-e78dec50-3daa4741_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:21.117449Z :INFO: [] MessageGroupId [src] SessionId [src|240acb54-e0f6d844-e78dec50-3daa4741_0] Write session will now close
2025-10-01T14:06:21.117454Z :DEBUG: [] MessageGroupId [src] SessionId [src|240acb54-e0f6d844-e78dec50-3daa4741_0] Write session: aborting
2025-10-01T14:06:21.117572Z :INFO: [] MessageGroupId [src] SessionId [src|240acb54-e0f6d844-e78dec50-3daa4741_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:21.117577Z :DEBUG: [] MessageGroupId [src] SessionId [src|240acb54-e0f6d844-e78dec50-3daa4741_0] Write session: destroy
2025-10-01T14:06:21.118927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|240acb54-e0f6d844-e78dec50-3daa4741_0 grpc read done: success: 0 data: 
2025-10-01T14:06:21.118939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|240acb54-e0f6d844-e78dec50-3daa4741_0 grpc read failed
2025-10-01T14:06:21.118947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|240acb54-e0f6d844-e78dec50-3daa4741_0 grpc closed
2025-10-01T14:06:21.118952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|240acb54-e0f6d844-e78dec50-3daa4741_0 is DEAD
2025-10-01T14:06:21.119210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:21.125101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254425136591693:2495] destroyed
2025-10-01T14:06:21.125133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:21.125142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.125145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.125147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:06:21.143350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.143368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.143370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-01T14:06:21.180099Z :ERROR: [/Root] [] [] Failed to select database: no available database. Status: NOT_FOUND
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to select database: no available database " }
2025-10-01T14:06:21.246436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.246456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.246458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.346449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.346466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.346469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.720217Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1759327581720210
2025-10-01T14:06:21.810601Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556254425083700037:2088];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:21.810624Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:21.812809Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/tmpqFtEAx/pdisk_1.dat
2025-10-01T14:06:21.821219Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:21.830992Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:21.838427Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:21.838487Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-01T14:06:21.868659Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:21.890233Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:21.890272Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:21.894953Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:06:21.895314Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 61022, node 3
2025-10-01T14:06:21.913642Z INFO: TTestServer started on Port 2510 GrpcPort 61022
2025-10-01T14:06:21.909731Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:21.910233Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/yandexuD3Kon.tmp
2025-10-01T14:06:21.910236Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/yandexuD3Kon.tmp
2025-10-01T14:06:21.910290Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/0047e0/r3tmp/yandexuD3Kon.tmp
2025-10-01T14:06:21.910311Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:21.917156Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:21.917195Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:21.919120Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:2510
PQClient connected to localhost:61022
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:21.950999Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-01T14:06:21.961390Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
waiting...
waiting...
waiting...
2025-10-01T14:06:22.030788Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:22.212082Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254429109510390:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.212104Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254429109510399:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.212114Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.213280Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:22.214529Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254429109510446:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.214555Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.217232Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556254429109510418:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-01T14:06:22.283298Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556254429378668350:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:22.284403Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=ZDU5YzU3NDEtMjk3MTcyOTgtZDA1ODkzOGMtYTVkNjE5N2Y=, ActorId: [3:7556254429378668308:2322], ActorState: ExecuteState, TraceId: 01k6g1gy254d6ezm872dg2j2dq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:22.284537Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:22.285990Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:22.302956Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:22.312751Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556254429109510499:2168] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:22.317948Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556254429109510522:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:22.318035Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=ZjQ3ZjcwMGEtODljYzFhYS1mNmUxYTlhMC1hZjllYjUyZQ==, ActorId: [4:7556254429109510386:2294], ActorState: ExecuteState, TraceId: 01k6g1gy037qw0wpjgyfj37t6r, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:22.318179Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:22.331327Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:61022", true, true, 1000);
2025-10-01T14:06:22.366244Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6g1gy4b9r869fr4z6g8cx54, Database: , SessionId: ydb://session/3?node_id=3&id=MmQyMjc4NTQtNGFiYzNmZDgtYWQ4YjI5YjctZWU3NDQwODk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254429378668793:2980] 
2025-10-01T14:06:22.801652Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:22.813375Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:26.811070Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556254425083700037:2088];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:26.811105Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:27.525630Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:61022
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:27.565742Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:61022
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:27.575148Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.575775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.575835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:27.575842Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.575854Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:27.575928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254450853505846:3317], now have 1 active actors on pipe
2025-10-01T14:06:27.576122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.576975Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254450853505847:3318] connected; active server actors: 1
2025-10-01T14:06:27.576997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.577081Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:27.577177Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:27.577519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556254450584347375:2385], now have 1 active actors on pipe
2025-10-01T14:06:27.577536Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-01T14:06:27.577701Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:27.578980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254450853505912:3369], now have 1 active actors on pipe
2025-10-01T14:06:27.579037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.579771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.579907Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.579923Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:27.579968Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.580002Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556254450853505931:2462]
2025-10-01T14:06:27.580513Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.580520Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.580524Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556254450853505931:2462]
2025-10-01T14:06:27.580527Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:27.580698Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:27.580706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.580716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.580717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.580720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:27.580721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.580723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.580724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:27.580729Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.580782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.580802Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:27.581518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.581542Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327587626, TxId 281474976720677
2025-10-01T14:06:27.581544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.581545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.581569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.581603Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:27.581888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:27.582093Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-01T14:06:27.582131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:27.582141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.582142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.582144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.582148Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:27.582225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:27.582242Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.582269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.583550Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.583571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.585867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.587641Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6g1h37j641ejsnhthgs0dch, Database: , SessionId: ydb://session/3?node_id=3&id=OTVmMmRiZGEtMjQwZDdhODctNjgzZmEwM2QtYmVhZDZiNTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327587626
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327587626
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:61022
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:27.595438Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:27.680972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.680992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.680996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.781312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.781326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.781329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.881673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.881691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.881694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.982024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.982045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.982048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.082399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.082419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.082423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:61022
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.097255Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:28.182724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.182745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.182749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.283406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.283424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.283427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.383423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.383438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.383441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.483794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.483813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.483817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.584124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.584145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.584148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:61022
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.600591Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:28.601892Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:28.602068Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:28.602072Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:61022
2025-10-01T14:06:28.602331Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:28.602526Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.602540Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:28.602770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:28.602798Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53154
2025-10-01T14:06:28.602803Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53154 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:28.602806Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.606935Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:28.606993Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.606998Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.607000Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.607005Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.607690Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.628462Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:28.628562Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254455148473463:2500] connected; active server actors: 1
2025-10-01T14:06:28.628624Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:28.628632Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.628724Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254455148473463:2500] disconnected; active server actors: 1
2025-10-01T14:06:28.628730Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254455148473463:2500] disconnected no session
2025-10-01T14:06:28.643112Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.643130Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:28.643133Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254455148473425:2500] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.643141Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.643270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:06:28.643287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254455148473483:2500], now have 1 active actors on pipe
2025-10-01T14:06:28.643298Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.643304Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.643331Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:28.643345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.643353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.643356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.643367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.643384Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.643402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.643434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.643440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.643450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.643479Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0
2025-10-01T14:06:28.643782Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327588643 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:28.643826Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.643931Z :INFO: [] MessageGroupId [src] SessionId [src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:28.643941Z :INFO: [] MessageGroupId [src] SessionId [src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0] Write session will now close
2025-10-01T14:06:28.643947Z :DEBUG: [] MessageGroupId [src] SessionId [src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0] Write session: aborting
2025-10-01T14:06:28.644069Z :INFO: [] MessageGroupId [src] SessionId [src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:28.644074Z :DEBUG: [] MessageGroupId [src] SessionId [src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0] Write session: destroy
2025-10-01T14:06:28.644222Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0 grpc read done: success: 0 data: 
2025-10-01T14:06:28.644230Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0 grpc read failed
2025-10-01T14:06:28.644236Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0 grpc closed
2025-10-01T14:06:28.644241Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|98f6a44-52df3aaa-719bfbcb-4fe4a47f_0 is DEAD
2025-10-01T14:06:28.644491Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:28.644527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254455148473483:2500] destroyed
2025-10-01T14:06:28.644536Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:28.644542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.644544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.644545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.684478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.684493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.684496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: >>> Got event: ReadyToAcceptEvent
ok
2025-10-01T14:06:28.697668Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:61022" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:61022" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:61022" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-01T14:06:28.699700Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:28.699943Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:06:28.767018Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-01T14:06:28.768764Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.768930Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-01T14:06:28.770467Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.770483Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-01T14:06:28.770718Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.770775Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:38030
2025-10-01T14:06:28.770803Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:38030 proto=topic  topic=test-topic durationSec=0
2025-10-01T14:06:28.770807Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.771341Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-01T14:06:28.771382Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.771389Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.771391Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.771398Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.771989Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.774184Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:28.774303Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254455148473513:2515] connected; active server actors: 1
2025-10-01T14:06:28.774538Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-01T14:06:28.774550Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.774688Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254455148473513:2515] disconnected; active server actors: 1
2025-10-01T14:06:28.774700Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254455148473513:2515] disconnected no session
2025-10-01T14:06:28.777660Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.777675Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:28.777678Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.777687Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.777836Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:06:28.777857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254455148473527:2515], now have 1 active actors on pipe
2025-10-01T14:06:28.777864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.777870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.777896Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed074235-2448c653-696033b0-33f50d1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:28.777912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.777917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.777920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.777930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.777945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.777970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.778034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.778047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.778070Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.778118Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|ed074235-2448c653-696033b0-33f50d1b_0
2025-10-01T14:06:28.778448Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:28.778463Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327588778 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:28.778501Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|ed074235-2448c653-696033b0-33f50d1b_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-01T14:06:28.778588Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-01T14:06:28.778746Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:28.778758Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-01T14:06:28.778975Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|ed074235-2448c653-696033b0-33f50d1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:28.779090Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:28.779136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.779144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.779163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:28.779177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-01T14:06:28.779230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.779236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.779323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:06:28.779334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:28.779350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.779360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.779362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.779384Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:06:28.779449Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-01T14:06:28.779459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.779498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 160 WTime 1759327588779
2025-10-01T14:06:28.779517Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:28.779526Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 160
2025-10-01T14:06:28.780384Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 160 actorID [3:7556254450853505871:2462]
2025-10-01T14:06:28.780412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:28.780430Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:28.780436Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-01T14:06:28.780442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:28.780450Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-01T14:06:28.780475Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.780485Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:28.780488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.780490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.780492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.780499Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:28.780502Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:28.780506Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:28.780514Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:06:28.780547Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:06:28.780561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-01T14:06:28.780568Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 160 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:06:28.780572Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:28.780581Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-10-01T14:06:28.000000Z
2025-10-01T14:06:28.780593Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-01T14:06:28.780607Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:28.780609Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-01T14:06:28.780622Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-10-01T14:06:28.780641Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327588779 queuesize 0 startOffset 0
2025-10-01T14:06:28.780781Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:28.780915Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:28.780921Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-01T14:06:28.780925Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-01T14:06:28.784803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.784812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.784815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.886187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.886207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.886210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.986775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.986789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.986793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.092143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.092159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.092162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.190284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.190300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.190303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.290670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.290684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.290690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.391014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.391028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.391030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.491407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.491425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.491428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.591754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.591777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.591780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.692081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.692096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.692098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.778630Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.792443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.792459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.792462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.818346Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-01T14:06:29.818355Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254455148473494:2515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.892799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.892815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.892818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.993158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.993174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.993177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.093512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.093529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.093531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.193863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.193876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.193878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.294224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.294242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.294245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.394563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.394583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.394587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.494922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.494942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.494946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.595249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.595265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.595268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.695626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.695645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.695648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.795962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.795978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.795980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.896313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.896334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.896337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.996694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.996711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.996715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.097034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.097055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.097058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.197390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.197408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.197412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.297724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.297738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.297741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.398062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.398074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.398077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.498442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.498460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.498463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.598816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.598840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.598845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.699140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.699159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.699162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.802598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.802617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.802619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.902927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.902942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.902945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.005421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.005440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.005443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.105659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.105681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.105684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.206000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.206013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.206015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.306349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.306363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.306366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.406720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.406732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.406734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:32.453369836  115294 chttp2_transport.cc:1143]             ipv4:127.0.0.1:16030: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:32.507080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.507096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.507099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.582543Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:32.582558Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:32.582563Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:32.610459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.610479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.610482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.712301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.712314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.712317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.812511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.812528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.812530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.914447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.914472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.914475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.015438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.015454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.015457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.115843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.115858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.115861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.217378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.217398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.217401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.317588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.317606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.317610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.418092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.418109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.418112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.518282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.518301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.518303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.620484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.620504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.620508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:33.654877086  115370 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:16030: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:33.721032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.721049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.721052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.821351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.821365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.821368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.921698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.921720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.921724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.022075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.022094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.022097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.122437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.122456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.122459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.225550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.225568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.225571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.326447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.326466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.326469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.430474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.430498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.430502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.531129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.531148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.531151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.635205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.635222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.635226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.735290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.735307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.735313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.835569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.835586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.835588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.935992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.936007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.936010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.036358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.036374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.036378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.138187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.138204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.138207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.238653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.238668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.238671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.339085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.339101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.339103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.441390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.441405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.441408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.541138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.541155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.541158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.641554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.641575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.641578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.741876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.741891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.741894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.842209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.842224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.842227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.942611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.942638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.942641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.043897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.043919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.043922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.146191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.146206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.146210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.255521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.255537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.255540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.358280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.358296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.358299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.459041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.459060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.459064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.560568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.560586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.560589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.668741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.668766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.668770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.766924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.766946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.766951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.860585Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-01T14:06:36.860602Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:36.867246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.867261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.867263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.967578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.967594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.967597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.068007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.068046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.068049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.168339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.168369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.168373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.268688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.268704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.268707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.369568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.369588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.369591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.469902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.469920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.469924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.570246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.570262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.570264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.583154Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:37.583174Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:37.583179Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:37.670595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.670610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.670613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.770961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.770975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.770978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.871298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.871315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.871323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.971623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.971639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.971641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.074496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.074517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.074520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.174893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.174908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.174910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.275226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.275239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.275243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.375584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.375600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.375603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.476001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.476021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.476025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.577807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.577826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.577829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.679252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.679274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.679278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.779625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.779644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.779648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.879926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.879941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.879943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.980272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.980289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.980291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.080638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.080656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.080658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.180992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.181008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.181012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.281336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.281349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.281352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.382430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.382446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.382449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.482562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.482579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.482583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.582888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.582904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.582907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.688345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.688359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.688361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.788741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.788762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.788766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.889095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.889113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.889116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.989467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.989485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.989488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.089934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.089952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.089955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.190193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.190210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.190213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.290483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.290501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.290505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.390858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.390876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.390879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.491190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.491211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.491216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.591559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.591578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.591581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.691922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.691941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.691944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.792227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.792244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.792247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.892603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.892620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.892623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.992972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.992986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.992989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.093302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.093316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.093318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.193654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.193671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.193673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.294499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.294517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.294520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.398465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.398483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.398486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.500544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.500563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.500566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.600700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.600717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.600720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.701051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.701067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.701070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.801405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.801423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.801427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.901793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.901812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.901816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.002128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.002147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.002151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.102445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.102460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.102462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.202806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.202822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.202826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.303172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.303190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.303194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.406448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.406470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.406475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.506473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.506495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.506498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.583324Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:42.583344Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:42.583350Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:42.606781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.606800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.606804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.707102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.707129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.707132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.807464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.807480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.807483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.907838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.907859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.907862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.008191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.008208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.008212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.108549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.108568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.108572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.208881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.208895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.208898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.309263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.309283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.309287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.409594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.409609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.409612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.509957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.509977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.509980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.610295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.610313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.610317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.710654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.710672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.710676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.814452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.814473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.814477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.914534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.914547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.914550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.016572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.016590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.016594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.118045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.118064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.118068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.218534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.218558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.218561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.318937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.318951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.318953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.419263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.419279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.419282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.519600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.519615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.519618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.619957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.619975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.619978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.720306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.720322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.720326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.820672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.820689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.820692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.920967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.920983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.920986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.021372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.021390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.021393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.121723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.121744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.121747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.222089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.222107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.222109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.322456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.322474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.322477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.422777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.422794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.422797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.523122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.523140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.523143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.623503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.623518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.623521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.724543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.724561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.724564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.825921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.825939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.825942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.926084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.926107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.926110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.027526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.027546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.027550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.127269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.127281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.127285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.229025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.229038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.229041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.328970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.328983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.328985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.431925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.431948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.431951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.532802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.532822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.532826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.633184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.633205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.633210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.733491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.733509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.733512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.833849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.833866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.833870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.934208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.934224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.934227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.034564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.034581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.034585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.134934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.134953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.134956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.235269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.235287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.235291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.335591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.335608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.335610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.435964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.435981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.435984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.536312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.536329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.536332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.583512Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:47.583529Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:47.583535Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:47.636665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.636682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.636685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.737016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.737046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.737049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.837319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.837334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.837337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.937750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.937800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.937807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.038091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.038115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.038119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.138465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.138495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.138501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.238768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.238782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.238785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.339132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.339149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.339151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.439491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.439510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.439512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.539851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.539867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.539870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.640181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.640197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.640200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.740534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.740547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.740550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.840996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.841012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.841015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.954427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.954445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.954448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.054017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.054041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.054044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.154420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.154436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.154440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.254598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.254613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.254616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.354943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.354959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.354962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.455395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.455417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.455420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.555631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.555651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.555654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.655975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.655995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.655999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.756342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.756368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.756370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.856693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.856716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.856720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.957073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.957093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.957096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.057398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.057413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.057417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.157768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.157786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.157789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.258117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.258139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.258142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.358468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.358485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.358489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.458798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.458816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.458819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.559157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.559173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.559176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.662442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.662462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.662465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.762469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.762486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.762489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.863820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.863845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.863848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.964396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.964415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.964418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.064457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.064472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.064475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.164886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.164904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.164907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.265217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.265235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.265238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.365553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.365573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.365577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.465933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.465953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.465957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.566257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.566274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.566277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.666634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.666649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.666652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.766977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.766998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.767001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.867325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.867344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.867348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.967693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.967713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.967717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.068030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.068048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.068052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.168384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.168409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.168412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.268720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.268740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.268744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.372186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.372209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.372212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.472503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.472519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.472522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.572868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.572884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.572886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.583995Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:52.584015Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:52.584020Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:52.673379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.673402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.673406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.773567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.773585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.773590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.873908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.873926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.873929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.974303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.974325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.974329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.074597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.074616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.074619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.175460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.175494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.175498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.275848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.275867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.275870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.378425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.378452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.378455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.478569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.478586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.478589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.578963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.578982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.578985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.679412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.679430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.679433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.782540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.782561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.782564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.885088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.885103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.885106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.989226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.989249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.989252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.089875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.089907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.089911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.190295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.190314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.190318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.293907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.293926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.293929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.394030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.394053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.394057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.494423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.494443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.494445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.594771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.594788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.594793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.695132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.695155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.695157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.795418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.795446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.795449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.895932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.895949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.895953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.996172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.996190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.996194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.096480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.096506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.096509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.196816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.196857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.196860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.297229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.297248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.297252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.397544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.397569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.397573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.497920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.497947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.497950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.598269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.598289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.598294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.698579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.698611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.698614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.798956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.798975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.798978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.900718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.900735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.900738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.002486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.002506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.002510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.102592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.102609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.102613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.202963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.202983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.202987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.304466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.304484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.304487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.406450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.406472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.406476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.506576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.506595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.506598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.606918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.606937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.606940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.708279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.708300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.708304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.808617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.808633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.808636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.909027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.909049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.909052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.009357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.009390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.009394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.112393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.112414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.112416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.212626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.212646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.212649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.312900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.312915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.312917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.413307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.413328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.413332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.519316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.519333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.519336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.578203Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:06:57.577647Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:06:57.577684Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-01T14:06:57.578709Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:06:57.578843Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:06:57.579774Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-01T14:06:57.584044Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:57.584068Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:06:57.584073Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:06:57.619609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.619628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.619633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.720020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.720040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.720043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.822483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.822500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.822503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.922852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.922869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.922872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.023750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.023778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.023781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.124104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.124121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.124124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.224329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.224348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.224351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.324669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.324690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.324693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.425023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.425040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.425043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.525446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.525463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.525466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.625832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.625862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.625867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:58.668327197  115370 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:16030: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
>>> Ready to answer: ok
2025-10-01T14:06:58.726291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.726313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.726316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.826969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.826990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.826994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.928613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.928635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.928638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.030508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.030531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.030534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.134437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.134454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.134457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.234498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.234513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.234516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.335159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.335185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.335190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.435727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.435749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.435753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.536072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.536093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.536098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.638436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.638456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.638459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.738318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.738336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.738339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.838670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.838693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.838696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.942890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.942908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.942910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.046276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.046304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.046309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.148766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.148783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.148786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.254669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.254689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.254692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.355696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.355716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.355719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.458747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.458767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.458771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.561711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.561736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.561740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.661966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.661985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.661989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.762544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.762565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.762570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.862648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.862667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.862671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.966469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.966492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.966496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.070433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.070453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.070456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.173257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.173278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.173281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.273273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.273288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.273291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.373572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.373590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.373593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.473999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.474017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.474021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.574331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.574349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.574352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.674755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.674859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.674865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.775078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.775110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.775115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.875346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.875378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.875383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.975768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.975796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.975803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.078679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.078695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.078697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.182447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.182467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.182470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.282514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.282534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.282538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.386467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.386495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.386499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.486721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.486747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.486752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.584617Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:02.584633Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:07:02.584637Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:07:02.587065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.587081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.587084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.687644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.687666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.687669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.788418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.788435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.788438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.888676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.888698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.888702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.989024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.989044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.989048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.089324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.089342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.089345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.189723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.189744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.189747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.290612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.290632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.290635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.391863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.391881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.391884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.494528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.494550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.494553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.594707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.594728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.594732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.698599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.698620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.698624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.803242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.803267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.803271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.905504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.905531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.905534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.005780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.005797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.005801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.106182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.106212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.106216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.210673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.210703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.210706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.314449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.314471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.314475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.414419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.414439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.414442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.515415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.515433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.515435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.618440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.618462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.618464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.718526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.718549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.718553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.821022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.821043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.821047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.926445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.926470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.926473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.025200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.025215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.025219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.125583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.125604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.125607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.225929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.225947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.225950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.326286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.326310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.326329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.430404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.430423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.430426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.531764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.531788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.531793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.632803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.632843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.632847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.734493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.734516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.734519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.834668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.834685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.834688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.938450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.938481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.938484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.038794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.038814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.038817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.142580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.142602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.142606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.242748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.242767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.242771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.343162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.343179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.343184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.443441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.443460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.443463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.544875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.544892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.544895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.645175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.645195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.645199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.745569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.745586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.745590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.845875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.845891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.845895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.951426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.951445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.951462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.051976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.051993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.051997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.154470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.154492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.154496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.254453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.254473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.254477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.354833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.354869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.354873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.457725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.457749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.457752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.558041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.558059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.558063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.584788Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:07.584806Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:07:07.584811Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:07:07.658810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.658829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.658831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.758805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.758823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.758826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.859106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.859125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.859128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.962406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.962424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.962427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.062401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.062421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.062423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.168495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.168518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.168521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.268751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.268766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.268769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.369095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.369113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.369116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.470596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.470618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.470622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.571064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.571100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.571103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.671389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.671404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.671406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.705701Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:61022" location: "dc1" status: UNAVAILABLE weight: 500 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:61022" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:61022" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-01T14:07:08.705853Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:07:08.705895Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:07:08.706345Z :INFO: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-01T14:07:08.706353Z :INFO: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session will now close
2025-10-01T14:07:08.706389Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:07:08.706389Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-01T14:07:08.706459Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.706563Z :INFO: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-01T14:07:08.706569Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ed074235-2448c653-696033b0-33f50d1b_0]  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:07:08.711035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|ed074235-2448c653-696033b0-33f50d1b_0 grpc read done: success: 0 data: 
2025-10-01T14:07:08.711066Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|ed074235-2448c653-696033b0-33f50d1b_0 grpc read failed
2025-10-01T14:07:08.711078Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|ed074235-2448c653-696033b0-33f50d1b_0 grpc closed
2025-10-01T14:07:08.711087Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|ed074235-2448c653-696033b0-33f50d1b_0 is DEAD
2025-10-01T14:07:08.711161Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:08.711171Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-01T14:07:08.711354Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-01T14:07:08.711450Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.711505Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:38030
2025-10-01T14:07:08.711517Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:38030 proto=topic  topic=test-topic durationSec=0
2025-10-01T14:07:08.711520Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:08.711618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:07:08.711698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254455148473527:2515] destroyed
2025-10-01T14:07:08.711715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:07:08.711724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.711734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.711736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.712336Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-01T14:07:08.712376Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:08.712377Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:08.712379Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:08.712385Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:08.712984Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:08.724393Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:08.733006Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:08.733027Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:08.733031Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:08.733040Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:08.733580Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254626947168755:3130], now have 1 active actors on pipe
2025-10-01T14:07:08.733580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:07:08.733587Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.733593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.733615Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:08.733622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.733625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.733627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:08.733637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.733649Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:08.733661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.733790Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.733794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.733806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.733830Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0
2025-10-01T14:07:08.734441Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:07:08.734456Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327628734 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:07:08.734574Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-01T14:07:08.774559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.774578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.774582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.876041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.876061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.876064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.975258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.975276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.975280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.075949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.075966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.075969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.178458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.178486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.178489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.278729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.278748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.278752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.378763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.378781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.378784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.479390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.479415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.479418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.579435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.579454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.579457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.679783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.679798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.679801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.731961Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:09.743165Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-01T14:07:09.743180Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254626947168726:3130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:09.780145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.780163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.780167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.882504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.882525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.882528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.983115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.983135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.983139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.083228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.083246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.083248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.190445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.190467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.190470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.290518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.290534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.290537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.394482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.394499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.394501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.495857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.495874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.495877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.596913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.596926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.596929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.698455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.698478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.698483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.798558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.798577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.798587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.899402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.899420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.899423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.005335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.005357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.005361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.103179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.103197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.103200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.203636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.203656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.203660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.303837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.303852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.303856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.406443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.406460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.406463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.506569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.506585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.506587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.608109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.608124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.608127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.709723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.709740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.709744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.810268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.810288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.810291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.913006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.913021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.913024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.018463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.018483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.018485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.123148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.123163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.123165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.223412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.223431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.223434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.330443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.330464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.330467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.434128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.434144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.434147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.534648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.534662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.534665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.584907Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:12.584924Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:07:12.584928Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:07:12.638449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.638466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.638468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.742475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.742492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.742495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.845163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.845181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.845184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.945890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.945904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.945907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.047456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.047473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.047477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.148252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.148264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.148267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.250571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.250588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.250592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.350972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.350988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.350991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.452753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.452770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.452773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.553255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.553272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.553275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.655648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.655664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.655667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.758560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.758578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.758581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.858826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.858844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.858847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.959132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.959149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.959152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.062444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.062470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.062473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.163124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.163143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.163147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.267002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.267017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.267019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.370436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.370454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.370457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.481200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.481219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.481222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.580964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.580981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.580985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.686495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.686516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.686520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.792882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.792903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.792906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.890950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.890970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.890972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.994873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.994897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.994900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.097301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.097326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.097330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.198477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.198497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.198500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.298475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.298499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.298503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.402225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.402249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.402252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.503219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.503234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.503238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.603659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.603674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.603677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.706414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.706434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.706437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.810624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.810646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.810650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.912332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.912355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.912359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.012888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.012911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.012914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.113342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.113363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.113366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.214668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.214687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.214690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.319192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.319215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.319218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.419355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.419378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.419381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.519636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.519657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.519661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.619916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.619943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.619947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.720310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.720331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.720334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.822679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.822703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.822707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.923108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.923124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.923127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.023422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.023440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.023443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.126670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.126690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.126694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.227657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.227678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.227682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.327535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.327553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.327556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.427922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.427941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.427946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.528277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.528296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.528300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.585158Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:17.585175Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:07:17.585180Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:07:17.629041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.629059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.629062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.729710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.729729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.729732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.830487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.830561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.830565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.930954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.930977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.930980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.031034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.031056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.031059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.131361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.131383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.131387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.231763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.231782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.231785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.335224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.335245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.335248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.438551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.438570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.438573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.538475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.538493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.538496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.638786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.638812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.638816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.739128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.739158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.739162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.839485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.839504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.839507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.942443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.942466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.942469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.042864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.042881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.042884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.144510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.144531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.144534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.244988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.245009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.245012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.345805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.345824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.345827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.445711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.445733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.445736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.546017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.546037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.546041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.646422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.646442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.646446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.746768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.746789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.746792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.850459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.850484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.850487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.959923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.959984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.959990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.058620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.058648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.058652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.158901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.159102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.159116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.264274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.264296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.264302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.366498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.366605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.366609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.467388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.467406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.467409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.570449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.570467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.570470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.670485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.670509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.670513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.770765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.770788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.770791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.875093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.875113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.875116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.976724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.976746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.976750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.077540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.077558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.077561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.177803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.177819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.177826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.281824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.281841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.281845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.382201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.382222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.382225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.486486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.486522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.486525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.590463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.590487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.590490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.689292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.689309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.689311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.790934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.790954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.790957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.891482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.891498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.891502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.991396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.991415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.991419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.091843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.091863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.091867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.192081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.192099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.192103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.292425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.292450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.292453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.394232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.394249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.394251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.494616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.494633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.494646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.585426Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:22.585444Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:07:22.585450Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:07:22.595029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.595050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.595054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.697388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.697412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.697415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.798503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.798525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.798530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.898642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.898659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.898661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.002436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.002456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.002460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.106396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.106421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.106424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.205933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.205952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.205955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.306149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.306168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.306171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.407005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.407028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.407032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.507397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.507415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.507419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.610447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.610475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.610478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.712331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.712351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.712355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.814578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.814595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.814599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.915773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.915796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.915799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.016306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.016325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.016329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.118500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.118522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.118525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.219768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.219788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.219792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.320018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.320038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.320042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.422553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.422575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.422579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.522694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.522716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.522719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.623069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.623086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.623088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.723538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.723556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.723558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.828570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.828585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.828588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.929957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.929978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.929981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.030091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.030110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.030114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.130449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.130469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.130473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.234846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.234866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.234869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.335247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.335267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.335271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.435554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.435573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.435577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.535959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.535979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.535982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.638670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.638688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.638693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.738736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.738784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.738790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.846915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.847119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.847134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.946551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.946575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.946578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.046988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.047010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.047013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.148444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.148474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.148477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.248650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.248672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.248675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.354568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.354588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.354591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.452427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.452453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.452456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.552834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.552856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.552868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.653146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.653169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.653173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.754520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.754543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.754547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.857847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.857871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.857874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.960783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.960800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.960803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.062545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.062568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.062572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.166638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.166660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.166663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.266720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.266736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.266739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.366905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.366925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.366928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.470526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.470547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.470551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.570645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.570664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.570668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.588851Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:27.588871Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-10-01T14:07:27.588876Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-10-01T14:07:27.595126Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:07:27.595159Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-01T14:07:27.595906Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:07:27.596239Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:07:27.596309Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:07:27.670936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.670957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.670960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.771321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.771339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.771342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.871627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.871653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.871656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.974566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.974587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.974589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.074962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.074986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.074990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.175307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.175327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.175330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.277554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.277574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.277578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.377026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.377046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.377050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.477634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.477665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.477669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.579062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.579081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.579085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.679086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.679106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.679110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:07:28.738263Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-01T14:07:28.738851Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:07:28.738865Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-01T14:07:28.745363Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:28.745491Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:28.746501Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.746522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.746570Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:28.746599Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-01T14:07:28.746731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.746736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.746758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:07:28.746765Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:28.746782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.746790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.746792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:28.746824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-01T14:07:28.746875Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-10-01T14:07:28.746882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.746929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1759327648746
2025-10-01T14:07:28.746954Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:28.746965Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-10-01T14:07:28.755303Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [3:7556254450853505871:2462]
2025-10-01T14:07:28.755335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:28.755368Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:28.755380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:07:28.755392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-01T14:07:28.755426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.755428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.755431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.755442Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:28.755444Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:28.755447Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:28.755452Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:28.755463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 320 CachedBlobs 2
2025-10-01T14:07:28.755471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:07:28.755494Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-01T14:07:28.755963Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:07:28.756051Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 8000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:07:28.756057Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-01T14:07:28.756061Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-01T14:07:28.756152Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-01T14:07:28.779448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.779465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.779468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.882465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.882487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.882490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.982865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.982886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.982889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.083053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.083070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.083073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.183434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.183451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.183455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.286132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.286153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.286156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.394511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.394532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.394536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.498544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.498562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.498566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.598726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.598745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.598748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.701206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.701232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.701235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.805517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.805537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.805541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.905889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.905910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.905912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.006165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.006187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.006191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.107258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.107278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.107281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.207620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.207635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.207637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.310395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.310409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.310412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.410693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.410712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.410716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.513136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.513155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.513158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.613453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.613471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.613475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.714546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.714566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.714570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.814659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.814678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.814681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.915009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.915030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.915034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.015285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.015304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.015366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.115720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.115739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.115743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.216053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.216073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.216076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.316431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.316453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.316455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.416783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.416809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.416824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.517180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.517202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.517206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.617450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.617467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.617471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.718478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.718495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.718498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.822438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.822468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.822471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.922549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.922570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.922573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.023024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.023047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.023051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.123348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.123368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.123372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.223700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.223723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.223726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.330789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.330813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.330818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.431115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.431136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.431138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.533127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.533145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.533148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.589423Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:32.589442Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:32.589445Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:32.589450Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:32.634530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.634547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.634550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.734674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.734696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.734700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.838678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.838701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.838704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.939060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.939077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.939081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.041464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.041490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.041494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.142233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.142248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.142250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.242577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.242595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.242598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.343535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.343563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.343567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.443805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.443824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.443827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.548329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.548347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.548350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.650525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.650546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.650549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.758451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.758470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.758473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.858779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.858798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.858803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.958844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.958866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.958870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.059259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.059279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.059284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.159565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.159584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.159588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.259943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.259963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.259967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.360253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.360273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.360277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.462612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.462632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.462636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.566454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.566479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.566483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.671154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.671180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.671184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.770398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.770420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.770424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.871454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.871476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.871479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.971597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.971623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.971626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.071945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.071965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.071969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.172681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.172706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.172711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.272619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.272632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.272635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.377013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.377032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.377035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.476919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.476939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.476942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.577522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.577540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.577543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.678526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.678549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.678551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.779156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.779173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.779175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.879330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.879347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.879349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.979716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.979738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.979742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.082489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.082513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.082517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.181956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.181975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.181978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:07:36.250984382  115387 chttp2_transport.cc:1143]             ipv4:127.0.0.1:16030: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-01T14:07:36.282310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.282329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.282333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.384630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.384659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.384662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.484558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.484581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.484585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.584909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.584927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.584930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.688742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.688766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.688770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.789323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.789343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.789346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.889547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.889566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.889570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.990238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.990256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.990259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.090256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.090277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.090280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.191923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.191943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.191947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.293311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.293331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.293335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.398103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.398128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.398131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.498591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.498613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.498616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.594559Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:37.594578Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:37.594582Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:37.594587Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:37.599447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.599468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.599471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.699471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.699496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.699500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.803085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.803113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.803116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.906508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.906530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.906534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.006726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.006750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.006754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.107079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.107102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.107106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.207437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.207461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.207465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.307771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.307791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.307794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.408229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.408251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.408255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.510011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.510033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.510037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.610436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.610459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.610464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.713840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.713860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.713863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.814362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.823384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.823394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.914544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.914562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.914566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.014845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.014863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.014866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.116117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.116143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.116146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.216502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.216530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.216534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.317196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.317216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.317220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.417315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.417334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.417338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.517992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.518018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.518021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.618983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.619005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.619008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.718849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.718869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.718872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.823907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.823929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.823932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.924177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.924197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.924201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.024663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.024683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.024687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.124868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.124888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.124892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.226063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.226082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.226086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.326895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.326911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.326915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.427856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.427883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.427886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.528720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.528740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.528744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.629268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.629288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.629291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.731285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.731308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.731311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.830438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.830455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.830458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.930757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.930778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.930782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.034576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.034601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.034605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.135058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.135078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.135082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.235444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.235463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.235467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.335778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.335799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.335803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.436129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.436147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.436151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.536467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.536488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.536491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.636842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.636865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.636868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.737157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.737174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.737177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.837505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.837525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.837530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.937902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.937921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.937925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.042444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.042470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.042474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.142650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.142671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.142674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.243025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.243047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.243051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.343373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.343393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.343397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.447214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.447252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.447256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.547606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.547629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.547633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.596769Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:42.596791Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:42.596796Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:42.596803Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:42.650820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.650839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.650842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.754443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.754468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.754471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.855654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.855678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.855682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.956166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.956187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.956190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.056580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.056602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.056605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.158695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.158723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.158725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.262533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.262557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.262561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.362647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.362667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.362671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.465659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.465678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.465681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.566118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.566136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.566139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.666385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.666404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.666409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.766746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.766764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.766767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.867936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.867961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.867965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.968559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.968582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.968585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.069988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.070004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.070008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.170149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.170174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.170177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.270538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.270561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.270564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.370893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.370916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.370920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.471186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.471206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.471210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.573385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.573408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.573412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.673586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.673607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.673610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.776349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.776370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.776374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.876725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.876741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.876744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.978443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.978463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.978466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.077933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.077951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.077954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.178327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.178349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.178353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.279000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.279022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.279026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.379593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.379616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.379620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.479893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.479913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.479917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.580222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.580243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.580247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.682495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.682515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.682518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.786224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.786246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.786250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.890445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.890468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.890470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.993032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.993054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.993057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.096545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.096561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.096564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.196886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.196906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.196909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.298620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.298654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.298657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.400456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.400475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.400479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.510676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.510696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.510700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.604284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.604305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.604309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.704700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.704718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.704722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.804923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.804943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.804947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.905314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.905333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.905336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.005668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.005689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.005693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.106041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.106073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.106078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.206352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.206386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.206389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.306852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.306873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.306878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.407361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.407382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.407386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.508308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.508330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.508334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.596569Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:47.596592Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:47.596596Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:47.596602Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:47.608827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.608845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.608849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.709222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.709244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.709248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.809551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.809568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.809572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.910571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.910591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.910594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.011868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.011888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.011891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.112085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.112108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.112111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.214956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.214976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.214979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.315038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.315055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.315057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.414719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.414738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.414742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.518521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.518540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.518547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.620853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.620878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.620883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.720278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.720299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.720303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.820690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.820711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.820716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.921008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.921027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.921030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.021390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.021412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.021415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.121740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.121760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.121764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.222069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.222089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.222093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.325366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.325388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.325391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.425383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.425413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.425417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.525901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.525918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.525920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.626046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.626061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.626063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.730452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.730474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.730478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.834570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.834590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.834593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.938533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.938556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.938560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.038721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.038740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.038743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.139081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.139107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.139109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.239979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.240000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.240004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.340286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.340306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.340309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.440636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.440657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.440662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.541073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.541093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.541096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.641344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.641366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.641370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.741696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.741720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.741724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.846442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.846467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.846471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.950452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.950478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.950481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.050467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.050491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.050495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.150802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.150823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.150827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.251155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.251180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.251183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.351620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.351648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.351651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.451790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.451813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.451816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.552197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.552215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.552218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.652559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.652578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.652582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.752899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.752918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.752922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.853257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.853278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.853282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.953605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.953625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.953628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.053962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.053982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.053985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.154311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.154336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.154340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.254654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.254675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.254677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.358439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.358460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.358468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.458429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.458451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.458464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.558792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.558815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.558818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.596738Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:52.596757Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:52.596760Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:52.596764Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:52.659150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.659171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.659175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.761132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.761151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.761155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.861376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.861398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.861401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.961724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.961743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.961746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.062089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.062108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.062111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.162434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.162452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.162456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.262794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.262813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.262816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.363088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.363109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.363113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.463469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.463485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.463487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.563867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.563887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.563889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.664174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.664196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.664200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.764549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.764570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.764574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.864901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.864922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.864925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.965267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.965288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.965291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.065575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.065594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.065596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.165958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.165983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.165987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.266318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.266336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.266339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.366676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.366696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.366699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.467419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.467440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.467442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.567341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.567360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.567362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.667722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.667744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.667747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.768074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.768093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.768096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.868435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.868454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.868456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.968779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.968820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.968822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.069124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.069143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.069146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.170289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.170309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.170312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.270871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.270892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.270896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.371210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.371233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.371236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.471560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.471581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.471585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.571919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.571941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.571945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.672274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.672298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.672301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.772603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.772623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.772627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.872955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.872976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.872979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.973319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.973341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.973344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.074546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.074569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.074572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.174532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.174554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.174556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.279655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.279678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.279681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.379859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.379883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.379887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.480190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.480211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.480214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.580556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.580578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.580581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.680900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.680972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.680975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.781246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.781362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.781370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.881588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.881604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.881606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.981960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.982023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.982027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.082296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.082314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.082316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.182673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.182693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.182696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.289053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.289093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.289097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.389514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.389537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.389540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.489868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.489913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.489916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.590206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.590229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.590233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.595328Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:07:57.595453Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-01T14:07:57.595847Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:07:57.596957Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:07:57.596971Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:07:57.596976Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:07:57.596983Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:07:57.596161Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:07:57.596210Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:07:57.690578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.690600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.690603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.791003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.791025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.791028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.891272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.891291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.891295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.991632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.991660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.991662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.094441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.094459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.094462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.194980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.195004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.195007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.294743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.294763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.294766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.398440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.398459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.398462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.499277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.499297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.499300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.599373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.599396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.599399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.699710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.699728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.699731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:07:58.800096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.800119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.800122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.900832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.900854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.900859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.002527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.002546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.002549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.104913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.104934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.104937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.205125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.205148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.205153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.305410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.305431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.305434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.405790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.405812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.405815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.506123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.506143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.506146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.606486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.606509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.606513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.706831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.706852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.706856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.807198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.807219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.807223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.907527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.907546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.907550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.008972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.008996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.008999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.110495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.110514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.110518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.213744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.213764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.213766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.314200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.314223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.314226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.414504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.414529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.414532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.514751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.514777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.514780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.615106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.615124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.615126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.715383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.715402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.715406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.815827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.815848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.815851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.916140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.916164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.916167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.016514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.016537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.016541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.116878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.116902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.116906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.217188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.217210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.217213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.317583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.317602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.317606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.417924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.417947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.417952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.518297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.518317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.518320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.618770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.618791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.618795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.718990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.719012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.719015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.820972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.821000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.821004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.922614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.922640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.922644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.022107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.022130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.022133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.122464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.122484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.122487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.222784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.222804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.222809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.326536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.326555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.326558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.427697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.427719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.427722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.527953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.527978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.527982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.597202Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:02.597225Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:02.597229Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:08:02.597234Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:08:02.629679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.629696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.629700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.730205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.730228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.730231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.830558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.830578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.830581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.930895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.930917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.930920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.031636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.031659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.031662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.131576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.131594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.131596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.231957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.232047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.232055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.333489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.333507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.333510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.433673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.433699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.433705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.538491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.538514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.538517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.638494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.638518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.638522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.738838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.738853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.738856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.841504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.841523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.841527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.941589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.941608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.941611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.041932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.041950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.041952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.142445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.142463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.142466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.242637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.242660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.242662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.343608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.343635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.343640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.443851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.443873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.443877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.544181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.544216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.544219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.644553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.644571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.644573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.744901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.744921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.744925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.846807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.846834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.846837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.948896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.948918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.948921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.049031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.049050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.049053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.153948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.153964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.153967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.255198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.255219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.255222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.355771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.355785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.355787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.456223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.456241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.456243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.557832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.557849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.557851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.658443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.658472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.658475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.759301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.759328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.759333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.861460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.861478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.861480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.962741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.962761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.962764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.066879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.066902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.066906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.166757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.166780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.166784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.267079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.267097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.267101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.367431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.367464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.367467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.467765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.467786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.467788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.568351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.568372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.568375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.668521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.668539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.668542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.768855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.768880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.768883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.869188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.869209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.869212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.971575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.971597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.971600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.070428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.070449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.070452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.174438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.174460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.174463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.274638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.274652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.274655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.375310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.375330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.375334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.475841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.475867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.475870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.576463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.576488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.576490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.597784Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:07.597806Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:07.597811Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:08:07.597817Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:08:07.678028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.678049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.678053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.778463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.778497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.778500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.878848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.878867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.878870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.979724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.979746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.979750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.080127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.080145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.080157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.180416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.180440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.180443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.280754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.280777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.280780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.381136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.381156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.381159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.481492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.481513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.481517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.581849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.581869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.581873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.682199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.682220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.682224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.712873Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:61022" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:61022" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:61022" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-01T14:08:08.713006Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:08:08.713037Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:08:08.713320Z :INFO: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-01T14:08:08.713324Z :INFO: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session will now close
2025-10-01T14:08:08.713343Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:08:08.713415Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-01T14:08:08.713436Z :INFO: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-01T14:08:08.713440Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0]  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:08:08.713458Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.713549Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-01T14:08:08.713727Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:08.713752Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-01T14:08:08.715024Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.715062Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:38030
2025-10-01T14:08:08.715067Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:38030 proto=topic  topic=test-topic durationSec=0
2025-10-01T14:08:08.715070Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:08.715152Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0 grpc read done: success: 0 data: 
2025-10-01T14:08:08.715154Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0 grpc read failed
2025-10-01T14:08:08.715159Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0 grpc closed
2025-10-01T14:08:08.715164Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|a263a2d8-f83fb751-674aec14-264c3c0e_0 is DEAD
2025-10-01T14:08:08.715351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:08:08.715569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254626947168755:3130] destroyed
2025-10-01T14:08:08.715582Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:08:08.715593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.715596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.715598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.715677Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-01T14:08:08.715706Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:08.715709Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:08.715710Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:08.715714Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:08.716294Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:08.719583Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:08.722840Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:08.722852Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:08.722856Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:08.722862Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:08.723493Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:08:08.723516Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254884645211469:3992], now have 1 active actors on pipe
2025-10-01T14:08:08.723527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.723533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.723559Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dce2c471-ff529cb8-54e7b62-d9148781_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:08.723577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.723585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.723587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:08.723599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.723617Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:08.723638Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.723722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.723731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.723754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.723787Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|dce2c471-ff529cb8-54e7b62-d9148781_0
2025-10-01T14:08:08.724085Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:08:08.724102Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327688724 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:08:08.724160Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|dce2c471-ff529cb8-54e7b62-d9148781_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-01T14:08:08.782548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.782571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.782574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.882897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.882917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.882920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.983233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.983259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.983263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.083603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.083624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.083628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.184997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.185017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.185019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.285330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.285352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.285356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.385675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.385692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.385694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.486030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.486048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.486052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.586386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.586408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.586411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.688612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.688632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.688634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.724112Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:09.730345Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-01T14:08:09.730356Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254884645211438:3992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:09.788615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.788631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.788633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.889224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.889250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.889254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.989324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.989346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.989350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.089690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.089711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.089714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.190223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.190234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.190236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.290464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.290487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.290490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.390737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.390763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.390767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.491074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.491095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.491097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.591456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.591478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.591482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.691780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.691799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.691801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.794505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.794526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.794530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.895043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.895070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.895074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.995400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.995421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.995425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.095807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.095831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.095834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.196106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.196137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.196141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.296480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.296498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.296501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.396812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.396836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.396840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.497159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.497178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.497181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.597511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.597531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.597532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.697854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.697871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.697873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.798209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.798232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.798235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.898554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.898572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.898576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.998919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.998944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.998946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.099278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.099299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.099302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.199624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.199654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.199656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.300032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.300052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.300055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.400324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.400350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.400353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.502532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.502560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.502564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.598015Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:12.598045Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:12.598051Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:08:12.598057Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:08:12.603099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.603121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.603125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.703877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.703903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.703907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.804328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.804356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.804361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.906407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.906431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.906446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.006621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.006644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.006647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.106905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.106926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.106929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.208108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.208138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.208140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.308100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.308120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.308122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.408468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.408489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.408492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.508808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.508834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.508838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.609186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.609222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.609226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.709500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.709523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.709527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.809883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.809902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.809904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.910201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.910228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.910231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.010557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.010576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.010579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.110952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.110978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.110981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.211280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.211302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.211306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.311607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.311636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.311640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.411964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.411981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.411984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.512334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.512358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.512362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.612706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.612730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.612734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.712994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.713013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.713017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.813389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.813411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.813414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.913737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.913761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.913764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.014080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.014102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.014105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.114429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.114449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.114452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.214772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.214795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.214800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.315128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.315152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.315155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.415484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.415508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.415511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.515843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.515861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.515863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.616185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.616205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.616208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.716540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.716565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.716569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.816883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.816903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.816906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.917253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.917274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.917276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.017560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.017589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.017591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.117927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.117945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.117948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.218288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.218309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.218312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.318672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.318692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.318695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.418939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.418959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.418962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.519374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.519391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.519394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.619710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.619727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.619730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.720047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.720065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.720067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.820421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.820444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.820448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.920737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.920759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.920769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.021123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.021143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.021146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.121462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.121483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.121487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.221800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.221818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.221821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.322148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.322165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.322168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.422531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.422553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.422557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.522901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.522921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.522924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.598219Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:17.598240Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:17.598243Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:08:17.598247Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:08:17.623245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.623274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.623278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.723565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.723584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.723587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.823922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.823944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.823948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.924297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.924316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.924319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.024621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.024640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.024642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.124998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.125016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.125019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.225375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.225398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.225401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.325685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.325710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.325714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.426064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.426086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.426090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.526386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.526404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.526406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.626746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.626764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.626767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.727102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.727129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.727132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.827465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.827486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.827490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.927818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.927842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.927845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.028161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.028177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.028186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.128492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.128514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.128518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.228904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.228930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.228933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.329222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.329242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.329245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.429587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.429606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.429609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.529903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.529925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.529928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.630274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.630290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.630292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.730606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.730627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.730631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.830987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.831011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.831014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.931308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.931325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.931327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.031687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.031710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.031713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.132025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.132045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.132048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.232384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.232405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.232407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.332740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.332764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.332767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.433059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.433086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.433089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.533474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.533497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.533501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.633798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.633815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.633817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.734143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.734168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.734171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.834431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.834450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.834453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.934864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.934888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.934892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.035222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.035247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.035251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.135547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.135568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.135571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.235896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.235914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.235917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.336246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.336273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.336277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.436596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.436622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.436625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.536963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.536982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.536986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.637299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.637323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.637327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.737668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.737690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.737693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.838004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.838025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.838028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.938462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.938486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.938489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.038709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.038729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.038732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.139069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.139102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.139107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.239389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.239414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.239417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.339766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.339790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.339793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.440133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.440156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.440160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.540439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.540463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.540466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.598400Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:22.598420Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:22.598425Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:08:22.598431Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:08:22.640830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.640852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.640855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.741172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.741189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.741191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.841542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.841561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.841564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.941899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.941922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.941925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.042256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.042283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.042287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.142611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.142635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.142640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.246428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.246450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.246452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.346389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.346411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.346413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.446698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.446717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.446721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.547832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.547851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.547855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.647938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.647963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.647967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.748285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.748307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.748311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.848656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.848677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.848680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.949017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.949038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.949040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.049344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.049362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.049365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.149689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.149710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.149713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.250072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.250098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.250102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.350404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.350426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.350430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.450742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.450764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.450768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.551124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.551147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.551151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.651468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.651493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.651498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.751817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.751838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.751841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.852179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.852198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.852201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.952497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.952513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.952515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.052878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.052896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.052898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.153201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.153222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.153226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.253554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.253572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.253575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.353957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.353984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.353988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.454258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.454285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.454288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.554627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.554649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.554652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.654990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.655016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.655020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.755349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.755371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.755375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.855668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.855689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.855693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.956032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.956054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.956058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.056386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.056408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.056412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.156767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.156872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.156878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.257104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.257123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.257126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.357478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.357499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.357503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.457904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.457928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.457931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.558815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.558842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.558845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.662478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.662504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.662509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.763156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.763178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.763181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.863792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.863812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.863815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.964153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.964176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.964180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.065237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.065258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.065261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.165681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.165703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.165706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.265971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.265995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.265998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.366343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.366364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.366368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.466939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.466960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.466963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.573936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.573962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.573966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.596404Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:08:27.596435Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-01T14:08:27.596980Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:08:27.598566Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:27.598577Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:27.598581Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-10-01T14:08:27.598585Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-10-01T14:08:27.597402Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:08:27.597443Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:08:27.679077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.679097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.679100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.780191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.780217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.780221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.880176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.880204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.880210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.980832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.980854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.980857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.080857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.080880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.080884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.181181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.181211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.181215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.281534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.281554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.281557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.381895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.381925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.381928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.482664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.482685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.482689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.586455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.586483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.586486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.686532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.686552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.686556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.788191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.788210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.788213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:08:28.820667Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-01T14:08:28.820982Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:08:28.820998Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
2025-10-01T14:08:28.821825Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|dce2c471-ff529cb8-54e7b62-d9148781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:28.821942Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:28.822014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.822031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.822068Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:28.822106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-01T14:08:28.822195Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.822212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.822238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-01T14:08:28.822254Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:28.822276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.822287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.822290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:28.822330Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-01T14:08:28.822406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-10-01T14:08:28.822417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.822474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 160 WTime 1759327708822
2025-10-01T14:08:28.822507Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:28.822525Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 160
2025-10-01T14:08:28.823987Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 160 actorID [3:7556254450853505871:2462]
2025-10-01T14:08:28.824025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:08:28.824055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:08:28.824073Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:08:28.824088Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-01T14:08:28.824122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.824131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.824133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.824132Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-01T14:08:28.824144Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:08:28.824147Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:08:28.824149Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00000?
2025-10-01T14:08:28.824153Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 480 bytes (480)
2025-10-01T14:08:28.824159Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 480 (8388608)
2025-10-01T14:08:28.824177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 480 CachedBlobs 3
2025-10-01T14:08:28.824194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:08:28.824241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-01T14:08:28.824508Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:08:28.824669Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:08:28.824689Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-01T14:08:28.824694Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-01T14:08:28.825019Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|dce2c471-ff529cb8-54e7b62-d9148781_0 grpc read done: success: 0 data: 
2025-10-01T14:08:28.825030Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: src_id|dce2c471-ff529cb8-54e7b62-d9148781_0 grpc read failed
2025-10-01T14:08:28.825036Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: src_id|dce2c471-ff529cb8-54e7b62-d9148781_0 grpc closed
2025-10-01T14:08:28.825041Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|dce2c471-ff529cb8-54e7b62-d9148781_0 is DEAD
2025-10-01T14:08:28.825190Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:08:28.825251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254884645211469:3992] destroyed
2025-10-01T14:08:28.825267Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:08:28.825274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.825276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.825278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.825352Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-10-01T14:08:28.825380Z :ERROR: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-10-01T14:08:28.825387Z :ERROR: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-10-01T14:08:28.825392Z :INFO: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session will now close
2025-10-01T14:08:28.825407Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:08:28.831219Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|dce2c471-ff529cb8-54e7b62-d9148781_0]  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:08:28.888288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.888306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.888309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.988795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.988817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.988821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.090577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.090598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.090601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.191963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.191984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.191986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:14.949956Z :WriteSessionWriteInHandlers INFO: Random seed for debugging is 1759327574949950
2025-10-01T14:06:15.066396Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254400703938684:2084];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.066710Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:15.070002Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.070481Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556254399601533592:2084];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.070642Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004796/r3tmp/tmpT34Pwi/pdisk_1.dat
2025-10-01T14:06:15.077335Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.096611Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.098232Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.108847Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 16084, node 1
2025-10-01T14:06:15.153998Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004796/r3tmp/yandexDqjENw.tmp
2025-10-01T14:06:15.154024Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004796/r3tmp/yandexDqjENw.tmp
2025-10-01T14:06:15.154097Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004796/r3tmp/yandexDqjENw.tmp
2025-10-01T14:06:15.154138Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:15.157896Z INFO: TTestServer started on Port 17864 GrpcPort 16084
2025-10-01T14:06:15.168759Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.168792Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.170627Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:17864
2025-10-01T14:06:15.174101Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.174121Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.176006Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:15.176364Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
PQClient connected to localhost:16084
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:15.191668Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-10-01T14:06:15.243368Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720659, at schemeshard: 72057594046644480
waiting...
2025-10-01T14:06:15.337081Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.346685Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.517601Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399601533893:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.517680Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399601533867:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.517770Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.517627Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400703939606:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.517666Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400703939596:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.517695Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518475Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400703939637:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518499Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518558Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:15.518577Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400703939639:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518586Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518339Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399601533920:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518364Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518480Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399601533922:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.518503Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.519981Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254399601533898:2127] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.523430Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254400703939610:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:15.523498Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556254399601533897:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:15.571540Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.585350Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254400703939773:2713] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.604669Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254400703939790:2342], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.604758Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NjkyZjk0YjMtY2ZkNDcyNjMtMmIyMzEwZWEtNjJmNWU0YmE=, ActorId: [1:7556254400703939593:2323], ActorState: ExecuteState, TraceId: 01k6g1gqes46rbwn7y7tzfkb4j, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.605302Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.605692Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254399601533991:2172] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.605977Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.610192Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254399601534007:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.610265Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=MWU5OWE4ODQtZTVjNjJhM2MtM2M5MGJmYzEtOGI4YzcyMA==, ActorId: [2:7556254399601533865:2294], ActorState: ExecuteState, TraceId: 01k6g1gqes0gk1za1wnrbev4jv, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.610394Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.637651Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:16084", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:15.673067Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gqk5dmxa1b84yf4rtjyc, Database: , SessionId: ydb://session/3?node_id=1&id=NWM1MTdkNGYtNDUxN2FhNjUtYzFjYTlmNWMtOWUzYjE2ZTE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254400703940114:2966] 
2025-10-01T14:06:16.068613Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:16.072305Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:20.066402Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254400703938684:2084];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.066434Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:20.070427Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556254399601533592:2084];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.070461Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:20.819427Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:16084
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.847269Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:16084
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.860361Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254422178777109:3274] connected; active server actors: 1
2025-10-01T14:06:20.860419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.860566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.860824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.864923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.871776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.871845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.871852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.871869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.873517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254422178777131:2451], now have 1 active actors on pipe
2025-10-01T14:06:20.873529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254422178777108:3273], now have 1 active actors on pipe
2025-10-01T14:06:20.873605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.874443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:20.874873Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1gwnw3xs0p9d476fe95vb, Database: , SessionId: ydb://session/3?node_id=1&id=NTJmMDg3NTctNzkwNTM4MGMtZmY1YWJlZjctZTRhYWE1ODk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:20.876091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.885981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254422178777188:3328], now have 1 active actors on pipe
2025-10-01T14:06:20.886070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.887056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.887244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.887262Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.887302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.887371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254421076370982:2402]
2025-10-01T14:06:20.887988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.887998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.888004Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254421076370982:2402]
2025-10-01T14:06:20.888011Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.888313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.888326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.888354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.888356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.888359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.888361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.888363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.888364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.888370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.888443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.888471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-01T14:06:20.889785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.889825Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580934, TxId 281474976720679
2025-10-01T14:06:20.889830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.889833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.889859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.889898Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-01T14:06:20.891938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.892002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.892007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.892009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.892011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.892017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.892105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.892134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.892172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.893927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.893949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.894949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.990441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.990455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.990458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.093609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.093623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.093626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.190731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.190745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.190748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.291076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.291090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.291092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-01T14:06:21.391394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.391412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.391417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327580934
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327580934
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:16084
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.393758Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.491791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.491806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.491809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.592520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.592536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.592538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.694704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.694718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.694721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.798039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.798066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.798069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:16084
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.906456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.906474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.906478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.906906Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.918957Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.919221Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.919227Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:16084
2025-10-01T14:06:21.922230Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.926577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.926596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.934454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.934520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41982
2025-10-01T14:06:21.934525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41982 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.934531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.935090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.935127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.935129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.935131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.935136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.935600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.992762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.993116Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254426473744677:2488] connected; active server actors: 1
2025-10-01T14:06:21.993226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:21.993233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.997046Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254426473744677:2488] disconnected; active server actors: 1
2025-10-01T14:06:21.997053Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254426473744677:2488] disconnected no session
2025-10-01T14:06:22.006447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.006463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.006466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.031528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.031543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:22.031547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254426473744642:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.031555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.032359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:22.035028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254430768711995:2488], now have 1 active actors on pipe
2025-10-01T14:06:22.035080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.035092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.035131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|53f9fb58-e39921cb-4ad651f7-f1511a26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:22.035146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.035154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.035157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.035172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.035190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.035217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.039138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.039158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.039208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.042627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|53f9fb58-e39921cb-4ad651f7-f1511a26_0
2025-10-01T14:06:22.042986Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327582042 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:22.043017Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|53f9fb58-e39921cb-4ad651f7-f1511a26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:22.043093Z :INFO: [] MessageGroupId [src] SessionId [src|53f9fb58-e39921cb-4ad651f7-f1511a26_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:22.043098Z :INFO: [] MessageGroupId [src] SessionId [src|53f9fb58-e39921cb-4ad651f7-f1511a26_0] Write session will now close
2025-10-01T14:06:22.043102Z :DEBUG: [] MessageGroupId [src] SessionId [src|53f9fb58-e39921cb-4ad651f7-f1511a26_0] Write session: aborting
2025-10-01T14:06:22.043193Z :INFO: [] MessageGroupId [src] SessionId [src|53f9fb58-e39921cb-4ad651f7-f1511a26_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:22.043198Z :DEBUG: [] MessageGroupId [src] SessionId [src|53f9fb58-e39921cb-4ad651f7-f1511a26_0] Write session: destroy
2025-10-01T14:06:22.047426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|53f9fb58-e39921cb-4ad651f7-f1511a26_0 grpc read done: success: 0 data: 
2025-10-01T14:06:22.047440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|53f9fb58-e39921cb-4ad651f7-f1511a26_0 grpc read failed
2025-10-01T14:06:22.047448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|53f9fb58-e39921cb-4ad651f7-f1511a26_0 grpc closed
2025-10-01T14:06:22.047456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|53f9fb58-e39921cb-4ad651f7-f1511a26_0 is DEAD
2025-10-01T14:06:22.047729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:22.050472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254430768711995:2488] destroyed
2025-10-01T14:06:22.050503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:22.050512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.050516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.050518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Before CreateWriteSession
=== Inside ReadyToAcceptHandler
=== Session created
=== Inside ReadyToAcceptHandler
2025-10-01T14:06:22.074584Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-01T14:06:22.074845Z :INFO: [/Root] [] [] Start federated write session to database '' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "" DbInfos: [ { path: "/Root" endpoint: "localhost:16084" status: AVAILABLE weight: 100 } ] ControlPlaneEndpoint: localhost:16084 }
2025-10-01T14:06:22.074948Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:22.075162Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:06:22.090480Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-01T14:06:22.092511Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.092682Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-01T14:06:22.092887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:22.092902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-01T14:06:22.094613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.094654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53888
2025-10-01T14:06:22.094658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:53888 proto=topic  topic=test-topic durationSec=0
2025-10-01T14:06:22.094662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:22.095089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-01T14:06:22.095113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:22.095115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:22.095116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:22.095120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:22.095594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:22.097640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:22.097879Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254430768712027:2503] connected; active server actors: 1
2025-10-01T14:06:22.097892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-01T14:06:22.097895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.097970Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254430768712027:2503] disconnected; active server actors: 1
2025-10-01T14:06:22.097973Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254430768712027:2503] disconnected no session
2025-10-01T14:06:22.110416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.110436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.110440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.114409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254430768712043:2503], now have 1 active actors on pipe
2025-10-01T14:06:22.111923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.111939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:22.111942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254430768712011:2503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.111949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.112540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:22.116033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.116050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.116078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:22.116086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.116091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.116093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.116105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.116116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.116130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.118907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.118923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.118949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.122305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0
2025-10-01T14:06:22.122673Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:22.122692Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327582122 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:22.122730Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-01T14:06:22.126458Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-01T14:06:22.126611Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:22.126622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-01T14:06:22.126969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.127077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.127326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.127346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.127381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:22.127517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.134485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.134507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.134619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 115 offset: -1
2025-10-01T14:06:22.134636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.134651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.134658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.134660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.134690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:06:22.134743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 189 count 1 nextOffset 1 batches 1
2025-10-01T14:06:22.134749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.134795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 177 WTime 1759327582134
2025-10-01T14:06:22.134817Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.134829Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 177
2025-10-01T14:06:22.143261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.142972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 177 actorID [2:7556254421076370960:2402]
2025-10-01T14:06:22.143003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.143019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 177
2025-10-01T14:06:22.143027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.143037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.143058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-01T14:06:22.143093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:22.143099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:22.143104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.143106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.143109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.143118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:22.143120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 177 bytes (177)
2025-10-01T14:06:22.143136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 177 (8388608)
2025-10-01T14:06:22.143148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:06:22.143188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:06:22.143205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 177 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:06:22.143208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:22.143217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 177 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.143225Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-01T14:06:22.143232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-01T14:06:22.143238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.143250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 157 from pos 0 cbcount 1
2025-10-01T14:06:22.143265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582134 queuesize 0 startOffset 0
2025-10-01T14:06:22.143644Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:22.143822Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 8000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:22.143832Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-01T14:06:22.143838Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: acknoledged message 1
=== Inside AcksHandler
2025-10-01T14:06:22.144214Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
=== Inside ReadyToAcceptHandler
2025-10-01T14:06:22.144323Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:22.144333Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-01T14:06:22.145583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.145710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.145868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.145885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.145913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-01T14:06:22.146046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.146172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.146177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.146196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 107 offset: -1
2025-10-01T14:06:22.146206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.146221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.146230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.146233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.146260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-01T14:06:22.146299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 181 count 1 nextOffset 2 batches 1
2025-10-01T14:06:22.146309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.146358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 169 WTime 1759327582145
=== AcksHandler has written a message, closing the session
2025-10-01T14:06:22.146396Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.146409Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 169
2025-10-01T14:06:22.154494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 169 actorID [2:7556254421076370960:2402]
2025-10-01T14:06:22.154520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.154536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 169
2025-10-01T14:06:22.154539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.154551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.154562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-01T14:06:22.154599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.154605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.154607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.154618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:22.154624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-10-01T14:06:22.154628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 346 bytes (346)
2025-10-01T14:06:22.154631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 346 (8388608)
2025-10-01T14:06:22.154740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.155022Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:22.155066Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 8000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:22.155071Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-01T14:06:22.155075Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: acknoledged message 2
=== Inside AcksHandler
2025-10-01T14:06:22.154642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
=== Inside SessionClosedHandler
2025-10-01T14:06:22.158469Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
=== SessionClosedHandler has 'written' a message
2025-10-01T14:06:22.158512Z :INFO: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-01T14:06:22.158516Z :INFO: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session will now close
2025-10-01T14:06:22.158522Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:06:22.158662Z :WARNING: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-10-01T14:06:22.158667Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0]  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:06:22.161208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 grpc read done: success: 0 data: 
2025-10-01T14:06:22.161223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 grpc read failed
2025-10-01T14:06:22.161233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 grpc closed
2025-10-01T14:06:22.161241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|eb707e77-c5c521bb-c4f42a95-1d9ca074_0 is DEAD
2025-10-01T14:06:22.161524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:22.161668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254430768712043:2503] destroyed
2025-10-01T14:06:22.161689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:22.161699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.161701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.161704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.209707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.209725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.209728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
